-- Logs begin at Mon 2022-10-03 15:19:51 UTC, end at Mon 2022-10-03 16:15:58 UTC. -- Oct 03 15:50:27.667903 dv-cinder-844563-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 15:50:27.675305 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 15:50:27 2022] *** Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: nodename: dv-cinder-844563-13-iscsi Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: machine: x86_64 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: clock source: unix Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: pcre jit disabled Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: detected number of CPU cores: 4 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: current working directory: / Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: detected binary path: /usr/bin/uwsgi-core Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: your processes number limit is 47680 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: your memory page size is 4096 bytes Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: detected max file descriptor number: 2048 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: lock engine: pthread robust mutexes Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: thunder lock: enabled Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 15:50:27.681314 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 15:50:27.718085 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: Python main interpreter initialized at 0x55d242a459c0 Oct 03 15:50:27.718085 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: python threads support enabled Oct 03 15:50:27.718085 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: your server socket listen backlog is limited to 100 connections Oct 03 15:50:27.718085 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: your mercy for graceful operations on workers is 90 seconds Oct 03 15:50:27.718708 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 15:50:27.718808 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: *** Operational MODE: preforking *** Oct 03 15:50:27.719007 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: *** uWSGI is running in multiple interpreter mode *** Oct 03 15:50:27.719007 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: spawned uWSGI master process (pid: 105379) Oct 03 15:50:27.719211 dv-cinder-844563-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 15:50:27.719780 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: spawned uWSGI worker 1 (pid: 105380, cores: 1) Oct 03 15:50:27.720105 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: spawned uWSGI worker 2 (pid: 105381, cores: 1) Oct 03 15:50:27.720274 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 15:50:28.374607 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 15:50:28.386201 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 15:50:29.455002 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:50:29.455002 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: from cryptography.utils import int_from_bytes Oct 03 15:50:29.455780 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:50:29.455780 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: from cryptography.utils import int_from_bytes Oct 03 15:50:29.469535 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:50:29.469535 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: from cryptography.utils import int_from_bytes Oct 03 15:50:29.470059 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:50:29.470059 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: from cryptography.utils import int_from_bytes Oct 03 15:50:31.915621 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:50:31.916186 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:50:31.916390 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:50:31.916770 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:50:31.917027 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:50:31.917414 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.917736 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.917830 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:50:31.918217 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:50:31.918315 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.918404 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.918561 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:50:31.918705 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.918927 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:50:31.919029 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.919185 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:50:31.919283 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.919567 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.919667 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.919890 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.919985 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920145 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920231 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920456 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920539 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920832 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-13-iscsi {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.920934 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921155 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921239 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921463 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921583 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921768 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.921863 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922080 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922183 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922354 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922451 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922672 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922771 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.922972 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.923056 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-13-iscsi {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.923314 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.923469 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.923622 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.923912 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924018 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924215 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924320 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924520 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924621 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924874 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.924983 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.925186 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.925294 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.925488 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.925702 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.925802 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926014 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926113 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926324 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926421 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926635 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926751 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.926972 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.927063 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-13-iscsi {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.927809 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.927965 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.928266 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.928403 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.928557 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.928678 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.928940 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929040 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929268 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929367 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929577 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929680 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929896 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.929993 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-13-iscsi {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930228 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930317 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930531 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930628 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930854 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.930943 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931169 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931290 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931483 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931606 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931800 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.931924 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932097 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932251 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932408 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932579 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932711 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.932921 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933048 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933266 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933436 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933590 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933689 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933867 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.933953 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934177 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934271 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934492 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934579 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934815 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.934908 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935134 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935270 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935391 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935497 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935619 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935739 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.935905 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936047 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936220 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936308 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936522 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936626 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936851 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.936974 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937156 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937256 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937457 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937564 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937757 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.937846 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938037 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938127 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938344 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938449 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938734 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.938956 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939055 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939264 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939352 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939573 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939663 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939883 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.939983 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940178 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940278 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940486 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940574 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940815 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.940921 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941119 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941205 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941440 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941525 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941752 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.941853 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942057 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942144 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942371 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942467 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942686 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.942782 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.943994 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.944136 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.944227 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.944318 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.944398 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.944772 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945106 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945331 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945433 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945655 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945758 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.945989 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946077 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946294 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946380 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946548 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946643 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946845 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.946953 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947150 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947248 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947465 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947588 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947769 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.947900 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948072 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948168 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948374 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948471 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.948779 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949000 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949146 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949301 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949399 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949602 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949696 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949904 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.949999 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950206 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950338 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950506 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950804 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.950898 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951106 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951194 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951405 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951492 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951701 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.951788 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952014 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952329 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952422 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952629 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952735 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.952954 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953047 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953255 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953343 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953554 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953650 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953866 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.953954 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954166 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954254 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954468 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954554 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954782 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.954879 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955082 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955169 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955384 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955492 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955697 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955790 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.955999 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956098 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956299 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956400 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956611 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956701 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.956934 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957024 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957236 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957336 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957551 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957654 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957849 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.957944 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.958147 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.958248 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.958445 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.958557 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.958842 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959255 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959356 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959448 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959528 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959606 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959692 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959772 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.959987 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960086 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960293 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960387 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960600 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960688 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.960933 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961024 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961240 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961327 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961545 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961640 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961845 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.961939 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.962157 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.962243 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.962477 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.962570 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.962789 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.962885 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.963098 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.963184 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.963408 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.963503 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.963729 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:50:31.963818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964060 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964146 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964376 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964474 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964683 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.964814 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965019 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965119 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965341 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965460 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965650 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965755 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.965958 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966046 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966265 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966371 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966585 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966674 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966899 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.966985 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.967211 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.967845 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968001 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968099 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968445 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968526 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968779 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968779 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.968934 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969021 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969107 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969332 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969429 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969648 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969734 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.969954 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970039 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970268 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970362 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970590 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970677 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.970917 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971002 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971239 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971326 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971554 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971641 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971859 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.971952 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972165 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972307 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972471 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972559 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972830 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.972922 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973140 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973230 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973448 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973537 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973763 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.973860 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974073 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974179 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974685 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974775 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974861 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.974956 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975038 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975116 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975293 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975382 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975600 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975708 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975905 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.975992 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.976236 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.976323 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.976554 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.976651 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.976909 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977013 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977222 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977311 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977531 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977619 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977846 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.977954 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978157 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978267 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978464 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978554 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978772 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.978864 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979072 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979372 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979461 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979671 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979766 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.979977 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980075 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980269 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980361 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980587 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980674 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.980920 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981008 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981225 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981313 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981535 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981628 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981842 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.981938 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982146 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982235 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982451 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982545 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982756 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.982897 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983057 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983145 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983362 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983458 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983667 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983833 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.983968 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984056 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984285 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984372 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984588 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984684 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.984915 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985004 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985229 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985316 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985528 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985616 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985831 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.985918 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986140 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986234 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986448 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986543 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986754 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.986840 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987062 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987157 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987367 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987506 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987684 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987781 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.987994 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988108 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988302 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988395 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988615 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988736 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.988952 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.989058 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.989260 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.989356 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.989580 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.989670 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.990531 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991017 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991017 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991170 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991170 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991312 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991390 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991502 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991697 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.991792 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992028 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992130 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992356 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992463 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992664 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992766 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.992990 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993076 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993292 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993383 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993594 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993684 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993898 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.993991 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994200 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994301 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994506 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994596 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994812 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.994901 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995113 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995209 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995413 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995510 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995713 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.995801 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996037 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996128 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996343 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996429 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996650 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996769 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.996985 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997136 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997301 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997426 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997642 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997743 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.997954 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998058 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998271 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998397 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998575 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998745 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.998881 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999210 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999399 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999486 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999719 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:31.999818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000034 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000121 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000348 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000446 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000663 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.000836 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001007 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001096 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001311 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001406 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001628 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001728 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.001930 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002019 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002243 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002339 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002553 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002639 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002880 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.002966 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003194 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003290 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003510 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003596 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003816 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.003902 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004125 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004213 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004432 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004526 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004757 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.004848 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.005071 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.005162 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006424 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006424 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006599 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006690 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006770 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.006952 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007061 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007268 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007354 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007586 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007672 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007901 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.007988 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008225 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008366 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008541 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008636 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008882 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.008968 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009196 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009291 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009524 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009609 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009829 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.009918 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010139 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010234 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010446 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010539 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010754 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.010874 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011062 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011161 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011370 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011465 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011671 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011764 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.011972 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012066 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012278 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012365 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012589 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012674 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.012922 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013012 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013228 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013313 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013529 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013616 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013835 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.013930 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014138 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014223 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014441 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014527 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014745 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.014832 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015055 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015140 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015363 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015448 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015669 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015763 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.015978 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016064 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016287 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016450 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016587 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016671 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.016919 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017006 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017241 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017342 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017549 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017634 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017850 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.017936 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018152 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018247 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018475 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018559 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018783 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.018875 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019111 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019204 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019414 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019501 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019718 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.019811 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020027 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020117 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020332 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020416 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020747 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.020997 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021164 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021306 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021400 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021650 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021734 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.021977 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022067 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022297 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022390 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022612 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022697 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.022923 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023009 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023229 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023314 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023538 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023632 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023856 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.023940 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024159 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024243 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024467 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024565 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024802 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.024909 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025105 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025191 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025413 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025507 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025729 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.025815 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026039 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026297 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026391 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026715 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.026946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027033 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027258 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027341 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027581 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027668 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.027898 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028151 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028238 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028490 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028633 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028833 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.028922 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029155 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029239 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029463 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029561 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029765 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.029865 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030067 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030153 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030376 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030461 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030677 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030772 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.030978 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031106 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031282 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031376 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031588 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031683 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031888 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.031981 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032188 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032282 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032490 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032577 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032812 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.032913 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033124 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033210 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033427 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033515 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033735 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.033819 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034034 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034118 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034343 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034429 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034648 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034732 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.034948 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035047 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035247 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035334 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035547 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035633 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035852 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.035945 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036174 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036258 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036485 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036586 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036889 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.036994 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.037233 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.037420 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.037514 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.037737 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.037903 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038091 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038185 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038403 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038491 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038700 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.038795 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039001 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039094 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039302 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039396 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039603 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039698 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039900 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.039986 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040205 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040314 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040507 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040624 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040839 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.040962 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041143 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041272 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041428 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041587 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041729 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.041900 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042028 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042214 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042340 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042528 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042646 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042842 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.042928 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043155 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043254 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043467 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043554 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043774 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.043861 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044087 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044181 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044390 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044476 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044689 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.044837 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045026 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045115 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045327 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045427 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045628 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045714 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.045927 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046023 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046232 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046318 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046537 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046635 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046839 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.046932 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047146 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047242 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047452 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047546 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047752 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.047840 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048050 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048138 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048357 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048452 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048655 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048764 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.048981 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049082 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049286 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049382 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049604 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049692 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.049917 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050001 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050217 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050309 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050520 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050605 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050817 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.050901 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051116 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051210 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051414 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051500 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051717 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.051810 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.052013 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.052101 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.052912 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053080 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053205 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053291 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053523 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053618 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053830 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.053917 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054140 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054226 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054447 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054537 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054752 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.054845 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055056 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055140 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055355 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055448 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055662 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055747 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.055969 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056064 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056275 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056361 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056604 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056690 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.056939 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057035 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057244 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057329 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057553 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057641 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057857 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.057952 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058165 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058249 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058467 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058552 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058778 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.058914 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059088 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059175 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059397 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059482 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059698 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059797 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.059998 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060083 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060317 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060402 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060746 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.060961 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061047 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061282 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061415 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061597 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061689 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061915 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.061999 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062215 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062308 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062520 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062607 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062827 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.062915 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063131 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063218 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063436 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063530 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063738 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.063824 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064046 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064140 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064355 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064441 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064661 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064781 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.064995 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065093 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065301 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065388 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065602 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065689 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.065907 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066002 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066211 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066297 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066510 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066595 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066824 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.066984 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067127 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067211 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067431 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067525 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067735 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.067839 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.068603 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.068705 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.068941 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069067 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069244 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069332 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069553 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069883 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.069968 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070198 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070289 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070506 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070599 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070818 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.070904 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071125 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071214 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071440 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071576 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.071844 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072046 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072183 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072459 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072548 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072789 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.072892 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073103 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073190 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073411 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073498 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073713 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.073810 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074014 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074106 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074319 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074408 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074637 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074734 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.074938 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075067 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075240 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075384 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075541 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075700 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.075858 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076013 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076159 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076323 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076475 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076630 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.076912 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077002 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077226 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077312 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077529 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077618 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077866 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.077951 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078173 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078258 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078497 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078586 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078817 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.078909 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079129 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079223 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079449 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079537 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079752 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.079863 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080060 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080148 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080364 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080544 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080681 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.080886 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081023 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081199 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081331 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081525 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081664 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081851 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.081946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082179 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082266 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082488 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082584 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082808 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.082895 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083123 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083217 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083453 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083610 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083840 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.083955 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084156 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084263 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084470 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084559 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084806 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.084898 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085111 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085208 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085415 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085501 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085723 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.085810 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086026 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086125 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086328 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086467 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086647 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086795 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.086950 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087265 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087435 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087570 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087767 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.087862 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088079 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088166 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088388 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088474 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088703 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.088816 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089036 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089123 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089346 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089434 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089671 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089765 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.089979 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090064 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090295 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090380 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090598 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090694 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090907 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.090992 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091213 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091300 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091517 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091605 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091820 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.091909 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092121 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092220 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092445 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092540 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092772 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.092862 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.093092 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.093441 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.093674 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.093761 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.093982 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094069 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094296 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094381 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094608 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094695 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.094915 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095008 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095221 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095316 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095526 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095612 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095839 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.095924 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096161 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096255 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096462 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096549 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096783 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.096871 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097099 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097206 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097403 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097499 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097703 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.097791 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098003 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098101 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098307 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098394 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098606 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098692 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.098905 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.099089 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.099324 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.099465 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.099648 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.099784 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100032 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100119 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100344 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100430 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100653 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100827 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.100988 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101085 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101295 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101384 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101611 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101709 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.101918 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102007 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102226 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102316 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102532 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102631 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102840 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.102926 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103154 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103239 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103468 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103561 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103776 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.103862 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104083 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104170 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104390 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104490 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104695 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.104796 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105030 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105117 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105342 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105439 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105650 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105736 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.105964 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106050 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106277 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106376 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106592 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106680 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.106910 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107105 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107241 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107436 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107524 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107746 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.107832 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108057 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108152 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108366 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108453 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108681 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.108787 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109025 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109129 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109336 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109460 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109732 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.109951 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110203 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110303 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110538 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110859 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.110958 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111178 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111264 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111493 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111587 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111806 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.111939 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112120 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112241 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112435 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112520 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112761 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.112864 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113088 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113218 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113403 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113492 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113704 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.113791 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.114014 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.114101 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.114324 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.114486 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.114633 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.115237 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.115464 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.115554 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.115773 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.115869 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116081 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116168 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116390 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116696 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.116857 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117025 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117145 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117332 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117456 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117647 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117777 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.117964 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118099 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118292 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118418 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118606 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118735 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.118916 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.119051 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.119226 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.119371 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.119538 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.119689 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120004 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120096 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120317 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120413 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120634 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120755 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.120977 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121074 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121305 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121405 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121616 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121703 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.121930 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122062 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122255 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122461 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122547 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122625 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122846 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.122933 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.123151 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.123396 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.123484 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.123724 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.123811 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124044 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124139 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124349 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124435 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124650 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124755 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.124995 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125093 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125300 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125386 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125678 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125826 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.125994 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126170 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126309 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126485 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126628 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126808 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.126945 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127130 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127255 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127445 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127582 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127755 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.127900 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128076 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128211 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128380 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128534 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128682 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.128873 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129019 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129327 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129411 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129628 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129747 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.129931 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.130070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.130240 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.130448 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131094 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131284 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131492 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131608 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131696 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.131920 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132015 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132250 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132341 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132563 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132657 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132890 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.132976 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133195 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133284 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133505 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133591 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133805 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.133899 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134107 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134193 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134409 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134495 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134710 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.134815 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135019 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135112 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135320 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135407 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135623 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135722 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.135924 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136011 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136229 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136315 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136550 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136896 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.136983 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137199 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137286 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137512 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137609 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137814 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.137899 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138114 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138206 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138421 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138514 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138726 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.138854 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139036 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139122 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139346 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139434 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139652 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139775 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.139966 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140101 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140291 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140377 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140622 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140851 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.140942 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141186 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141288 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141516 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141602 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141847 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.141932 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142173 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142259 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142475 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142610 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142780 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.142866 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143083 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143177 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143404 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143489 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143712 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.143797 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144022 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144110 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144329 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144583 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144679 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.144956 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145044 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145263 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145351 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145569 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145655 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.145876 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146008 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146326 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146423 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146607 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146692 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.146913 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147000 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147220 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147307 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147533 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147621 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147840 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.147929 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148152 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148254 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148467 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148562 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148810 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.148900 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149129 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149215 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149438 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149536 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149750 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.149876 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150059 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150144 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150364 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150458 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150669 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150755 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.150980 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151074 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151288 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151375 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151599 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151691 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151911 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.151998 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.152215 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.152341 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.152565 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.152901 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153035 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153216 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153316 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153532 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153626 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153845 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.153929 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154150 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154237 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154460 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154545 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154775 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.154861 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155082 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155169 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155401 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155488 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155707 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.155793 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.156014 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.156101 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.156357 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.156682 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.156798 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157026 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157115 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157330 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157424 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157638 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157730 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.157938 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158026 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158241 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158328 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158557 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158643 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158872 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.158960 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159172 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159258 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159472 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159567 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159777 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.159863 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160076 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160165 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160376 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160471 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160676 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160814 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.160999 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.161130 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.161305 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.161440 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.161652 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.161787 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162037 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162125 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162419 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162515 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162733 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.162825 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163036 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163130 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163339 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163434 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163646 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163779 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.163947 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164037 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164250 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164337 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164549 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164636 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164877 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.164966 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165176 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165263 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165483 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165567 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165838 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.165931 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166099 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166187 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166404 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166490 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166710 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.166814 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167015 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167103 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167319 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167403 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167624 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167718 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.167933 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168019 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168240 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168325 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168542 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168635 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168869 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.168956 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169190 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169274 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169498 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169597 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169808 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.169896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170116 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170202 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170421 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170515 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170726 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.170818 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171134 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171368 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171456 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171671 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171757 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.171993 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172078 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172305 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172389 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172621 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172705 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.172958 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173061 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173265 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173358 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173589 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173673 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173895 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.173990 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174201 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174286 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174504 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174589 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174809 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.174904 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175116 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175211 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175425 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175511 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175731 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.175819 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176041 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176127 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176354 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176446 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176663 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.176805 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.177006 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.177103 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.177875 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.177973 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.178190 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.178461 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.178547 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.178792 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.178880 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179205 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179427 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179514 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179744 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.179831 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180065 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180153 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180384 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180470 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180691 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.180857 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.181018 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.181115 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.181257 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:50:32.181351 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.181664 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.181996 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.182311 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.182641 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.182974 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.183329 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.183649 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.183997 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.184331 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.184649 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.184994 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.185304 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:50:32.185548 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:50:32.338510 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO dbcounter [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Registered counter for database nova_api Oct 03 15:50:32.342372 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO dbcounter [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Registered counter for database nova_api Oct 03 15:50:32.360669 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.362752 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.368169 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writer thread running {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.370209 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writer thread running {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.425652 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.context [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3daa5e-fb60-4c09-9b5d-f502e7858b1c(cell1) {{(pid=105380) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 15:50:32.426747 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.context [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3daa5e-fb60-4c09-9b5d-f502e7858b1c(cell1) {{(pid=105381) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 15:50:32.430303 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.430781 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.431264 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.431740 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.432373 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:32.433199 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.433383 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:32.433649 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.434112 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.434562 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.435643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_concurrency.lockutils [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:32.436560 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:32.437676 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO dbcounter [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Registered counter for database nova_cell0 Oct 03 15:50:32.438579 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO dbcounter [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Registered counter for database nova_cell0 Oct 03 15:50:32.441691 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO dbcounter [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Registered counter for database nova_cell1 Oct 03 15:50:32.442564 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO dbcounter [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Registered counter for database nova_cell1 Oct 03 15:50:32.448828 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.450494 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.451987 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.453331 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.456243 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writer thread running {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.459499 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writer thread running {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.461530 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writer thread running {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.462268 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writer thread running {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.605566 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO dbcounter [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Registered counter for database nova_cell0 Oct 03 15:50:32.606387 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO dbcounter [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Registered counter for database nova_cell0 Oct 03 15:50:32.614476 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.618130 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:50:32.619466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writer thread running {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.622946 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writer thread running {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:50:32.963856 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: WARNING keystonemiddleware.auth_token [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:50:32.966969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: WARNING keystonemiddleware.auth_token [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:50:32.971585 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: WARNING keystonemiddleware.auth_token [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:50:32.975270 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: WARNING keystonemiddleware.auth_token [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:50:33.319688 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: WARNING keystonemiddleware.auth_token [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:50:33.325810 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: WARNING keystonemiddleware.auth_token [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:50:33.327321 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: WARNING keystonemiddleware.auth_token [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:50:33.331097 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d242a459c0 pid: 105381 (default app) Oct 03 15:50:33.333411 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: WARNING keystonemiddleware.auth_token [None req-2eb999d6-db07-4f14-ab73-ae01a44274eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:50:33.334116 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:33.335175 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002546 Oct 03 15:50:33.335591 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Oct 3 15:50:33 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:50:33.339482 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d242a459c0 pid: 105380 (default app) Oct 03 15:51:55.177446 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:55.178639 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Oct 03 15:51:55.179253 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:51:55.199141 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_api:SELECT=3 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.201341 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_cell0:SELECT=3 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.202062 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_cell1:SELECT=3 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.202803 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:56.085372 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-a9989652-ae2e-4157-bb88-5375e0f811d5 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:56.119643 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-a9989652-ae2e-4157-bb88-5375e0f811d5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933572 Oct 03 15:51:56.133138 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 15:51:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:58.777078 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:58.778091 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-8d5019d7-6399-4c55-89d4-7d609920ae2c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 03 15:51:58.778489 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:51:59.230588 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-b1465702-48d8-4d77-8cfb-acd030468b56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:59.278872 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-b1465702-48d8-4d77-8cfb-acd030468b56 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494180 Oct 03 15:51:59.279431 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:51:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 15:51:59.293716 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_api:SELECT=3 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.294534 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_cell0:SELECT=3 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.295513 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_cell1:SELECT=3 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.296532 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.506507 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-d1a91077-e13c-4ac0-8487-b96d769e29cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:59.574485 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-d1a91077-e13c-4ac0-8487-b96d769e29cf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285887 Oct 03 15:51:59.575078 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 15:51:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:02.195311 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-b1465702-48d8-4d77-8cfb-acd030468b56 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:02.196336 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-b1465702-48d8-4d77-8cfb-acd030468b56 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 03 15:52:02.197017 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:02.873052 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-cec55647-e025-44ef-b483-80e003bc9c50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:02.914612 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-cec55647-e025-44ef-b483-80e003bc9c50 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711217 Oct 03 15:52:02.916774 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:02.931058 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-7bcff31c-be3f-477c-8a60-7076c4f4ee53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:02.976161 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-7bcff31c-be3f-477c-8a60-7076c4f4ee53 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048392 Oct 03 15:52:02.977264 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 15:52:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:52:05.594084 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-cec55647-e025-44ef-b483-80e003bc9c50 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:05.595726 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-cec55647-e025-44ef-b483-80e003bc9c50 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 03 15:52:05.596322 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:06.020363 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-4156be55-e4f9-4a56-b22f-028d3dfb56ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:06.040008 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-4156be55-e4f9-4a56-b22f-028d3dfb56ca admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436903 Oct 03 15:52:06.040759 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:06.052848 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-a8c5fc89-c212-49fa-a833-a0fe81c8c5af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:06.083980 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-a8c5fc89-c212-49fa-a833-a0fe81c8c5af admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034786 Oct 03 15:52:06.084743 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 15:52:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:08.724988 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-4156be55-e4f9-4a56-b22f-028d3dfb56ca admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:08.726001 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-4156be55-e4f9-4a56-b22f-028d3dfb56ca admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 03 15:52:08.726399 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:09.153577 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-25b8fbfe-4f7d-4249-993c-6411caf66a66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:09.174787 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-25b8fbfe-4f7d-4249-993c-6411caf66a66 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441650 Oct 03 15:52:09.175341 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:09.187665 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-d517d059-f140-41a1-9a71-c21377278ac6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:09.217456 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-d517d059-f140-41a1-9a71-c21377278ac6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033051 Oct 03 15:52:09.218298 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 15:52:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:52:11.865062 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-25b8fbfe-4f7d-4249-993c-6411caf66a66 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:11.866133 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-25b8fbfe-4f7d-4249-993c-6411caf66a66 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Oct 03 15:52:11.866552 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:12.356328 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "id": "d4"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:12.377416 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504533 Oct 03 15:52:12.378191 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:12.390408 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-a49f8493-3cbf-409d-8184-458c3192a313 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:12.415595 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-a49f8493-3cbf-409d-8184-458c3192a313 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028898 Oct 03 15:52:12.416199 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Oct 3 15:52:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:15.567232 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:15.568286 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 03 15:52:15.568710 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:16.010196 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-acd420fc-4b63-466b-ba79-c03b304bbb4d admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:16.036222 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-acd420fc-4b63-466b-ba79-c03b304bbb4d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460836 Oct 03 15:52:16.036687 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 15:52:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:18.730669 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:18.731683 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-a2d798e1-42bc-4127-b60b-028884427ee9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 03 15:52:18.732294 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:19.249103 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-7fe3a684-e899-49b0-9a44-3bd03eb72b52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:19.269363 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-7fe3a684-e899-49b0-9a44-3bd03eb72b52 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.530280 Oct 03 15:52:19.269923 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:19.281883 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-4bc85b48-bf90-4645-bb59-a3bba2c725d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:19.309340 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-4bc85b48-bf90-4645-bb59-a3bba2c725d7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031075 Oct 03 15:52:19.309928 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 15:52:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:21.928261 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-7fe3a684-e899-49b0-9a44-3bd03eb72b52 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:21.929307 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-7fe3a684-e899-49b0-9a44-3bd03eb72b52 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 03 15:52:21.929708 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:22.375775 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-ab76cd16-d076-462b-a11c-8b7baff720d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "2", "vcpus": 1}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:22.398887 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-ab76cd16-d076-462b-a11c-8b7baff720d5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456008 Oct 03 15:52:22.399488 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:22.412753 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-34984ab7-b48b-4f54-898e-889b97658242 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:22.438520 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-34984ab7-b48b-4f54-898e-889b97658242 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029561 Oct 03 15:52:22.440059 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 15:52:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:52:25.093492 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-ab76cd16-d076-462b-a11c-8b7baff720d5 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:25.094496 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-ab76cd16-d076-462b-a11c-8b7baff720d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 03 15:52:25.094957 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:25.618220 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-ed69f674-8e96-4e7d-a6ad-798dff277b0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:25.640920 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-ed69f674-8e96-4e7d-a6ad-798dff277b0f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.539840 Oct 03 15:52:25.641888 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:25.653949 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-b2c3a122-1605-4b18-a34d-5a42136da53c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:25.670423 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.684685 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-b2c3a122-1605-4b18-a34d-5a42136da53c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034348 Oct 03 15:52:25.685392 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 15:52:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:28.318895 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-ed69f674-8e96-4e7d-a6ad-798dff277b0f admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:28.321059 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-ed69f674-8e96-4e7d-a6ad-798dff277b0f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002545 Oct 03 15:52:28.321959 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:28.776964 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-18b75517-f404-489c-b156-3fb9ddb6571d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:28.799471 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-18b75517-f404-489c-b156-3fb9ddb6571d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471443 Oct 03 15:52:28.800136 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:28.812252 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-8a2cf39d-648a-495e-b0fc-07161ef89ec5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:28.836705 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-8a2cf39d-648a-495e-b0fc-07161ef89ec5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028071 Oct 03 15:52:28.837469 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 15:52:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:31.530852 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-18b75517-f404-489c-b156-3fb9ddb6571d admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:31.533098 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-18b75517-f404-489c-b156-3fb9ddb6571d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Oct 03 15:52:31.536770 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:31.978030 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "id": "5", "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:31.984511 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:32.002327 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462428 Oct 03 15:52:32.003061 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Oct 3 15:52:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:32.018110 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-cf44d31c-a2cb-44ca-b47a-3344f2af3203 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:32.043166 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-cf44d31c-a2cb-44ca-b47a-3344f2af3203 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029933 Oct 03 15:52:32.043742 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Oct 3 15:52:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:48.181380 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:48.182401 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 03 15:52:48.182806 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:48.193418 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.574386 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-99c8bf90-5c42-4cd5-86aa-c01573d90d8b admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:48.595988 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-99c8bf90-5c42-4cd5-86aa-c01573d90d8b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407100 Oct 03 15:52:48.596762 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 15:52:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:49.897460 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:49.898834 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-928012af-d5e8-48c3-a7dc-c9b35711c0cd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001859 Oct 03 15:52:49.899352 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:50.427509 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-390e0f89-cc94-4e7d-95ff-131096daca1f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:50.432776 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.wsgi [None req-390e0f89-cc94-4e7d-95ff-131096daca1f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-390e0f89-cc94-4e7d-95ff-131096daca1f admin admin] Request method failure captured: Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept: application/json Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept-Encoding: gzip, deflate Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Connection: keep-alive Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Content-Length: 0 Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Host: 10.222.0.33 Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-System-Scope: None Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: User-Agent: python-novaclient Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Auth-Token: gAAAAABjOwVRZ2KYFtzU7-0oXLxWQAVgIa3olXExzFRLO0_dxYEh9V2iTW00cjPNhSUCDblKr5IXx-36Rw7EfKe6WZUjIqduDzj15r7dwnvDGUoP_TYsAi3T3TZrhr-BCMSHJlihmjipJmtjYpRZKZXNzvElKpfWusQDSiIBlMCUMJyM37G4xWw Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Id: None Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Name: None Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Identity-Status: Confirmed Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Is-Admin-Project: True Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Id: default Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Name: Default Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Name: admin Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Role: reader,member,admin Oct 03 15:52:50.436011 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Roles: reader,member,admin Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant: admin Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Name: admin Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User: admin Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Id: default Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Name: Default Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Name: admin Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: method: > Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: exception: Flavor 42 could not be found. Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: action_args: {'id': '42'} Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:50.437670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:50.441627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.443047 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-390e0f89-cc94-4e7d-95ff-131096daca1f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:50.444314 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-390e0f89-cc94-4e7d-95ff-131096daca1f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398543 Oct 03 15:52:50.444314 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 15:52:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 15:52:50.447656 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-9a508d84-b62d-4e18-b7fc-30c0a9861890 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:50.471016 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-9a508d84-b62d-4e18-b7fc-30c0a9861890 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026916 Oct 03 15:52:50.471549 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:50.482100 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-5c077882-1778-426e-8fb9-10d6ae06867d admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:50.505294 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-5c077882-1778-426e-8fb9-10d6ae06867d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027683 Oct 03 15:52:50.505832 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:50.515181 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-04bf1d39-0122-4c45-9f3e-94467319ae0d admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:50.521786 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.wsgi [None req-04bf1d39-0122-4c45-9f3e-94467319ae0d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-04bf1d39-0122-4c45-9f3e-94467319ae0d admin admin] Request method failure captured: Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept: application/json Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept-Encoding: gzip, deflate Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Connection: keep-alive Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Content-Length: 0 Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Host: 10.222.0.33 Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-System-Scope: None Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: User-Agent: python-novaclient Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Auth-Token: gAAAAABjOwVRZ2KYFtzU7-0oXLxWQAVgIa3olXExzFRLO0_dxYEh9V2iTW00cjPNhSUCDblKr5IXx-36Rw7EfKe6WZUjIqduDzj15r7dwnvDGUoP_TYsAi3T3TZrhr-BCMSHJlihmjipJmtjYpRZKZXNzvElKpfWusQDSiIBlMCUMJyM37G4xWw Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Id: None Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Name: None Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Identity-Status: Confirmed Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Is-Admin-Project: True Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Id: default Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Name: Default Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Name: admin Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Role: reader,member,admin Oct 03 15:52:50.525279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Roles: reader,member,admin Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant: admin Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Name: admin Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User: admin Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Id: default Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Name: Default Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Name: admin Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: method: > Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: exception: Flavor 42 could not be found. Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: action_args: {'id': '42'} Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:50.526652 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:50.527654 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:50.529070 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-04bf1d39-0122-4c45-9f3e-94467319ae0d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:50.530429 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-04bf1d39-0122-4c45-9f3e-94467319ae0d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015189 Oct 03 15:52:50.530429 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 15:52:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 15:52:51.739921 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-5c077882-1778-426e-8fb9-10d6ae06867d admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:51.740961 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-5c077882-1778-426e-8fb9-10d6ae06867d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 03 15:52:51.741358 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:52.272985 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-f474d515-7423-437f-ae90-84a932e5a0cd admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:52.278075 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.wsgi [None req-f474d515-7423-437f-ae90-84a932e5a0cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-f474d515-7423-437f-ae90-84a932e5a0cd admin admin] Request method failure captured: Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept: application/json Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept-Encoding: gzip, deflate Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Connection: keep-alive Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Content-Length: 0 Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Host: 10.222.0.33 Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-System-Scope: None Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: User-Agent: python-novaclient Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Auth-Token: gAAAAABjOwVTc1M245BK67FrZhpO7743tue89Lq30MPNUP7lwu6szn_oeKax1W6rGQTbjw6_HcsSqgxfAc7yqVNh4X1BaHTymlNztjG4BPujtBpAkPhPVUyaMJVJmfCYBJ228-9ZjEDl3N2RsI299rRrErLd6cL1MDKQOZLErjZovAu37zVM6IE Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Id: None Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Name: None Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Identity-Status: Confirmed Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Is-Admin-Project: True Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Id: default Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Name: Default Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Name: admin Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Role: reader,member,admin Oct 03 15:52:52.279594 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Roles: reader,member,admin Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant: admin Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Name: admin Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User: admin Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Id: default Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Name: Default Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Name: admin Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: method: > Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: exception: Flavor 84 could not be found. Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: action_args: {'id': '84'} Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:52.281141 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:52.282326 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.283896 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-f474d515-7423-437f-ae90-84a932e5a0cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:52.285210 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-f474d515-7423-437f-ae90-84a932e5a0cd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399803 Oct 03 15:52:52.285210 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 15:52:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 15:52:52.291014 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-86dfd69e-6a79-4748-b87c-835a05f90b0b admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:52.306589 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-86dfd69e-6a79-4748-b87c-835a05f90b0b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019112 Oct 03 15:52:52.307130 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:52.317353 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-1ae58ff6-a8a4-451c-9bd6-a8855557b88a admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:52.332882 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-1ae58ff6-a8a4-451c-9bd6-a8855557b88a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019766 Oct 03 15:52:52.333408 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:52.342716 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-04508ea6-14af-4e02-8790-23146c41bcd3 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:52.348293 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.wsgi [None req-04508ea6-14af-4e02-8790-23146c41bcd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-04508ea6-14af-4e02-8790-23146c41bcd3 admin admin] Request method failure captured: Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept: application/json Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept-Encoding: gzip, deflate Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Connection: keep-alive Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Content-Length: 0 Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Host: 10.222.0.33 Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-System-Scope: None Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: User-Agent: python-novaclient Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Auth-Token: gAAAAABjOwVTc1M245BK67FrZhpO7743tue89Lq30MPNUP7lwu6szn_oeKax1W6rGQTbjw6_HcsSqgxfAc7yqVNh4X1BaHTymlNztjG4BPujtBpAkPhPVUyaMJVJmfCYBJ228-9ZjEDl3N2RsI299rRrErLd6cL1MDKQOZLErjZovAu37zVM6IE Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Id: None Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Name: None Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Identity-Status: Confirmed Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Is-Admin-Project: True Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Id: default Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Name: Default Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Name: admin Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Role: reader,member,admin Oct 03 15:52:52.349818 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Roles: reader,member,admin Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant: admin Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Name: admin Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User: admin Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Id: default Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Name: Default Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Name: admin Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: method: > Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: exception: Flavor 84 could not be found. Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: action_args: {'id': '84'} Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:52.351417 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:52.352466 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:52.353627 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-04508ea6-14af-4e02-8790-23146c41bcd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:52.354619 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-04508ea6-14af-4e02-8790-23146c41bcd3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011934 Oct 03 15:52:52.354619 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Oct 3 15:52:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 15:52:53.556795 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-1ae58ff6-a8a4-451c-9bd6-a8855557b88a admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:53.557799 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-1ae58ff6-a8a4-451c-9bd6-a8855557b88a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 03 15:52:53.558197 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:54.086608 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-7169e47f-d3ff-40e9-9cda-40d0ed9d1fa9 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:54.092383 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.wsgi [None req-7169e47f-d3ff-40e9-9cda-40d0ed9d1fa9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-7169e47f-d3ff-40e9-9cda-40d0ed9d1fa9 admin admin] Request method failure captured: Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept: application/json Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Accept-Encoding: gzip, deflate Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Connection: keep-alive Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Content-Length: 0 Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Host: 10.222.0.33 Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Openstack-System-Scope: None Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: User-Agent: python-novaclient Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Auth-Token: gAAAAABjOwVViAXwFgIgHgZfQGg1dZtM-zVNjkKAFouzbS4QpZ_iTJbYctbRla-vv6A7ioV8YraaWUZupysxLluLoEqW4pgVAnK1ALN0n5C1LBjBuE08uQnqYQ9_K74pV7c1ZYf0jKBMIBF4usT9BZC6EUtgPI0ONqmOmhCD8UxNKNWtekPt9YE Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Id: None Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Domain-Name: None Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Identity-Status: Confirmed Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Is-Admin-Project: True Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Id: default Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Domain-Name: Default Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Project-Name: admin Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Role: reader,member,admin Oct 03 15:52:54.094274 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Roles: reader,member,admin Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant: admin Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-Tenant-Name: admin Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User: admin Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Id: default Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Domain-Name: Default Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: X-User-Name: admin Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: method: > Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: exception: Flavor 451 could not be found. Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: action_args: {'id': '451'} Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:54.095969 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:54.097670 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.098946 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-7169e47f-d3ff-40e9-9cda-40d0ed9d1fa9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:54.100154 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-7169e47f-d3ff-40e9-9cda-40d0ed9d1fa9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398361 Oct 03 15:52:54.100154 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:52:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 15:52:54.106021 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-e270e83e-968d-49f3-93c5-7b515888ee5a admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:54.122796 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-e270e83e-968d-49f3-93c5-7b515888ee5a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020886 Oct 03 15:52:54.123323 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:54.134139 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:54.149646 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019058 Oct 03 15:52:54.150184 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Oct 3 15:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:52:54.159618 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-68b16f37-50a8-47af-89db-8cd64af3f2b8 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:54.164591 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.wsgi [None req-68b16f37-50a8-47af-89db-8cd64af3f2b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-68b16f37-50a8-47af-89db-8cd64af3f2b8 admin admin] Request method failure captured: Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept: application/json Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Accept-Encoding: gzip, deflate Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Connection: keep-alive Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Content-Length: 0 Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Host: 10.222.0.33 Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-Api-Version: compute 2.92 Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Openstack-System-Scope: None Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: User-Agent: python-novaclient Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Auth-Token: gAAAAABjOwVViAXwFgIgHgZfQGg1dZtM-zVNjkKAFouzbS4QpZ_iTJbYctbRla-vv6A7ioV8YraaWUZupysxLluLoEqW4pgVAnK1ALN0n5C1LBjBuE08uQnqYQ9_K74pV7c1ZYf0jKBMIBF4usT9BZC6EUtgPI0ONqmOmhCD8UxNKNWtekPt9YE Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Id: None Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Domain-Name: None Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Identity-Status: Confirmed Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Is-Admin-Project: True Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Id: default Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Domain-Name: Default Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Project-Name: admin Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Role: reader,member,admin Oct 03 15:52:54.166109 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Roles: reader,member,admin Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0727be3aa6194ac280b9115cbd69b50d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0727be3aa6194ac280b9115cbd69b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant: admin Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Id: 0727be3aa6194ac280b9115cbd69b50d Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-Tenant-Name: admin Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User: admin Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Id: default Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Domain-Name: Default Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Id: 272aa82f64454c7aaff95459c4c29980 Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: X-User-Name: admin Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: method: > Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: exception: Flavor 451 could not be found. Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: action_args: {'id': '451'} Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:54.167748 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:54.168785 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: ERROR nova.api.openstack.wsgi Oct 03 15:52:54.170160 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-68b16f37-50a8-47af-89db-8cd64af3f2b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:54.171470 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-68b16f37-50a8-47af-89db-8cd64af3f2b8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011427 Oct 03 15:52:54.171470 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:52:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 15:52:55.414866 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:55.415933 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 03 15:52:55.416334 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:55.940299 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-92b5bd1f-704f-433b-8bb3-b5f2149aed88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:55.965060 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-92b5bd1f-704f-433b-8bb3-b5f2149aed88 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408062 Oct 03 15:52:55.965599 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 15:52:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:57.189975 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:57.190982 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 03 15:52:57.191384 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:57.717849 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-079fa372-c380-4459-870e-de60ee636b88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:57.737140 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-079fa372-c380-4459-870e-de60ee636b88 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401520 Oct 03 15:52:57.737680 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 15:52:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:58.975039 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:58.976043 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 03 15:52:58.976446 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:59.506428 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-f911cc8d-a0b4-48a0-a833-f78d205af6b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:59.524813 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-f911cc8d-a0b4-48a0-a833-f78d205af6b9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.409930 Oct 03 15:52:59.525349 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 15:52:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:53:00.790218 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:00.791220 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 03 15:53:00.791609 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:53:01.327180 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-20499ad9-3b40-4f04-a345-01f3b834d636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:01.346026 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-20499ad9-3b40-4f04-a345-01f3b834d636 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.413415 Oct 03 15:53:01.346578 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Oct 3 15:53:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 15:53:02.572998 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:02.573930 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 03 15:53:02.574328 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:53:03.092944 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-cd5390f1-83da-4e8b-8b36-89e56fe91ac0 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:03.115279 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-cd5390f1-83da-4e8b-8b36-89e56fe91ac0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404991 Oct 03 15:53:03.115879 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Oct 3 15:53:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:54:00.128511 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.129609 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-190a655f-3e21-43f2-814d-aaded9d60cb0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 03 15:54:00.130018 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:00.143356 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:00.534158 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-49f5935c-2ca8-4838-ad53-a4c60f86cbc0 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.555125 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-49f5935c-2ca8-4838-ad53-a4c60f86cbc0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.418294 Oct 03 15:54:00.555665 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:54:00.576814 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_api:SELECT=14 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:00.580820 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-e13b0ef5-de20-4e8c-b97c-0411e16b12ef admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.588308 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-e13b0ef5-de20-4e8c-b97c-0411e16b12ef admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012951 Oct 03 15:54:00.588890 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:00.601415 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-23c8e01a-cc40-4bd1-b9e6-0d715a7b8b50 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.608745 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-23c8e01a-cc40-4bd1-b9e6-0d715a7b8b50 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 Oct 03 15:54:00.609839 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:54:00.621104 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.629001 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011406 Oct 03 15:54:00.629526 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:00.640874 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-ac990070-0f31-441b-a105-008696076f35 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:00.647976 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-ac990070-0f31-441b-a105-008696076f35 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010918 Oct 03 15:54:00.648479 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Oct 3 15:54:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:57:00.619890 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:00.620939 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 03 15:57:00.621336 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:57:00.763890 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_api:SELECT=6 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:57:00.921776 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:00.926489 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:00.926955 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:00.927374 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:00.928075 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:00.928514 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:00.928961 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:00.960083 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-f7ee1272-77fe-4770-91af-a704c8a28c76 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197328 Oct 03 15:57:00.960638 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:57:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:57:02.063566 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:02.064576 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 03 15:57:02.065068 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:57:02.255761 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:02.259231 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:02.259708 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:02.260138 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:02.260895 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:02.261345 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:02.261763 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:02.281811 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-61525de5-3907-4e87-a676-1ebbb6a60d9b admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077100 Oct 03 15:57:02.282362 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:57:02 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:57:13.782496 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:13.783563 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Oct 03 15:57:13.783967 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:57:13.926829 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_cell0:SELECT=4 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:57:13.927544 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_cell1:SELECT=4 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:57:13.928256 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG dbcounter [-] [105381] Writing DB stats nova_api:SELECT=8 {{(pid=105381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:57:13.975844 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:13.979451 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:13.979926 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:13.980357 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:13.981100 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:13.981552 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:13.981970 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:14.007894 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-2d8aab8f-1dd5-46ef-acfd-d9be2aa82bd4 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085419 Oct 03 15:57:14.008383 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:57:13 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:57:15.081976 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG nova.api.openstack.wsgi [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] Calling method '>' {{(pid=105380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:15.082985 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: INFO nova.api.openstack.requestlog [None req-c7807df3-bbeb-4dc0-81bb-f262a274f80f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 03 15:57:15.083413 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: [pid: 105380|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Oct 3 15:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:57:15.279848 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG nova.api.openstack.wsgi [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Calling method '>' {{(pid=105381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:57:15.283290 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:15.283764 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:15.284191 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:15.284968 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:57:15.285419 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:57:15.285833 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: DEBUG oslo_concurrency.lockutils [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:57:15.307697 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: INFO nova.api.openstack.requestlog [None req-842d1fd7-ca55-46a7-a9fd-a4fa3bb2a7f7 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.079734 Oct 03 15:57:15.308268 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: [pid: 105381|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Oct 3 15:57:15 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:58:14.328006 dv-cinder-844563-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 15:58:14.328500 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: Mon Oct 3 15:58:14 2022 - graceful shutdown triggered... Oct 03 15:58:14.328949 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: Gracefully killing worker 1 (pid: 105380)... Oct 03 15:58:14.329880 dv-cinder-844563-13-iscsi devstack@n-api.service[105381]: Gracefully killing worker 2 (pid: 105381)... Oct 03 15:58:14.455340 dv-cinder-844563-13-iscsi devstack@n-api.service[105380]: DEBUG dbcounter [-] [105380] Writing DB stats nova_api:SELECT=4 {{(pid=105380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:15.328847 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: worker 1 buried after 1 seconds Oct 03 15:58:15.329279 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: worker 2 buried after 1 seconds Oct 03 15:58:15.329279 dv-cinder-844563-13-iscsi devstack@n-api.service[105379]: goodbye to uWSGI. Oct 03 15:58:15.330418 dv-cinder-844563-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 03 15:58:15.330959 dv-cinder-844563-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 15:58:15.333797 dv-cinder-844563-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 15:58:15.343201 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 15:58:15 2022] *** Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: nodename: dv-cinder-844563-13-iscsi Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: machine: x86_64 Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: clock source: unix Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: pcre jit disabled Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: detected number of CPU cores: 4 Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: current working directory: / Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: detected binary path: /usr/bin/uwsgi-core Oct 03 15:58:15.345553 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: your processes number limit is 47680 Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: your memory page size is 4096 bytes Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: detected max file descriptor number: 2048 Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: lock engine: pthread robust mutexes Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: thunder lock: enabled Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 15:58:15.346257 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 15:58:15.387671 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: Python main interpreter initialized at 0x55c1ddb919c0 Oct 03 15:58:15.387671 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: python threads support enabled Oct 03 15:58:15.387671 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: your server socket listen backlog is limited to 100 connections Oct 03 15:58:15.387671 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: your mercy for graceful operations on workers is 90 seconds Oct 03 15:58:15.388118 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 15:58:15.388118 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: *** Operational MODE: preforking *** Oct 03 15:58:15.388425 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: *** uWSGI is running in multiple interpreter mode *** Oct 03 15:58:15.388425 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: spawned uWSGI master process (pid: 120571) Oct 03 15:58:15.388629 dv-cinder-844563-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 15:58:15.389250 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: spawned uWSGI worker 1 (pid: 120587, cores: 1) Oct 03 15:58:15.390640 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: spawned uWSGI worker 2 (pid: 120588, cores: 1) Oct 03 15:58:15.390640 dv-cinder-844563-13-iscsi devstack@n-api.service[120571]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 15:58:16.052835 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 15:58:16.058920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 15:58:17.219494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:58:17.219494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Oct 03 15:58:17.220100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:58:17.220100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Oct 03 15:58:17.256027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:58:17.256027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Oct 03 15:58:17.256590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:58:17.256590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Oct 03 15:58:19.631604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:58:19.632291 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:58:19.632586 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:58:19.632816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:58:19.633058 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:58:19.633452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.633775 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.634093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.634414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.634746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.635055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.635377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.635693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.636020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.636278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.636593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.637123 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-13-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.637451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.637763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.638079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.638405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.638727 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.639147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.639341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.639849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.641351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.641351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.641351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.641649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.641893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.642181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.642503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.642812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.643150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.643455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.644447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-13-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.644796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.645113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.645426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.645861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.646172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.646479 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.646800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.647122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.647441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.647750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.648071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.648388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.648709 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.649040 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.649340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.649657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.649966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.650276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.650575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.650825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.651129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.651448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.651771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.652083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.652335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.652582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.652931 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.653253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.653559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.653866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.654169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.654478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.654781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.655094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.655402 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.655689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.656008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.656321 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.656645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.656977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.657297 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.657705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.657958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.658261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.658603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.658922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.659231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.659588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.659905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.660209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.660515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.660850 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.661170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.661506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.661811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.662083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.662354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.662657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.662974 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.663276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.663592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.663887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.664180 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.664489 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.664816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.665121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.665424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.665720 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.666037 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.666327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.666629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.666934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.667234 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.667559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.667878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.668182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.668486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.668812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.669122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.669437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.669740 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.670042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.670361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.670665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.670968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.671284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.671589 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.671891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.672208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.672509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.672848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.673160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.673466 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.673769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.674069 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.674379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.674682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.675517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.675830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.676122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.676454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.676890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.677222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.677537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.677843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.678151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.678509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.678814 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.679166 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.679504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.679819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.680153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.680484 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.680832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.681146 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.681459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.681786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.682094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.682403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.682713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.683027 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.683342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.683673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.683995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.684310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.684628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.684979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.685298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.685628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.685954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.686269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.686611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.686964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.687279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.687604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.687929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.688241 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.688551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.688910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.689261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.689571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.689886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.690204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.690515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.691615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.692026 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.692358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.692656 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.693000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.693314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.693658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.693972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.694308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.694618 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.694937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.695254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.695565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.695876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.696185 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.696488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.696825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.697132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.697447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.697750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.698077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.698416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.698726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.699064 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.699372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.699686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.699996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.700307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.700612 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.700950 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.701262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.701570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.701899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.702208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.702515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.702837 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.703143 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.703451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.703765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.704076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.704386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.704705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.705072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.705368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.708256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.709540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.709540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.709540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.709540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.709540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.710307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.710307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.710307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.710770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.710921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.711125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.711454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.711769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.712072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.712374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.712699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.713046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.713352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.713701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.714036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.714354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.714684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.714995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.715314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.715623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.715934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.716246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.716554 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.716899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.717213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.717533 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.717844 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.718169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.718478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.719062 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.719366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.719681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.720022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.720356 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.720670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.721018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.721327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.721642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.721983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.722545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.722724 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.722926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.723206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.723515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.723819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.724100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.724421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.724790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.725071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.725392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.725681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.726008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.726341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.726651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.726960 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.727279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.727590 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.727899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.728206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.728509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.728839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.729149 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.729462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.729768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.730075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.730376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.730687 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.730993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.731296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.731598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.731839 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:58:19.733093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733192 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:58:19.733277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:58:19.733441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:58:19.733618 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:58:19.733759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.733896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.733974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.734052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.734262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.734362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.734485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.734663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.734811 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.734969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.735127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.735265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.735455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.735570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.735778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.735909 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.736118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.736219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.736495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.736611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.736686 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.736879 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.737153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.737263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-13-iscsi {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.737996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.738258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.738396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.738614 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.738900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.739006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.739230 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.739329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.739542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.739646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.739851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.739956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.740164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.740263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.740475 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.740587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.740807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.741040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.741236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.741390 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.741534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.741694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.741858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.742012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.742155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.742297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.742441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.742611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.742799 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.743022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.743181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.743333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.743488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.743630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.743780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.743948 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.744093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.744234 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.744383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.744537 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-13-iscsi {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.744956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.745141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.745286 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.745441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.745596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.745748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.745912 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.746064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.746242 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.746405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.746549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.746701 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.746852 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.746995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.747151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.747323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.747474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.747625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.747769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.747919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.748086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.748231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.748374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.748515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.748658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.748827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.748987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.749422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.749576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.749719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.749877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.750030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.750182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.750182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.750478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.750627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.750777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.750935 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.751087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.751087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.751355 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.751504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.751666 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.751824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.751969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.752112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.752269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.752269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.752539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.752539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.752880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.753134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.753361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.753510 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.753664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.753808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.753953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.753953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.753953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.754370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.754527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.754671 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.754832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.755252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.755405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.755557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.755715 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.755859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.756009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.756153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.756306 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.756464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.756615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.756777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.756926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.757079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.757232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.757389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.757539 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.757682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.757830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.757980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.758132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.758132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.758422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.758574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.758726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.758868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.759018 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.759193 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.759661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.759820 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.759972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.760130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.760285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.760446 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.760606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.760780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.760939 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.761090 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.761247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.761398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.761548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.761703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.761853 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.761995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.762150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.762292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.762447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.762590 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.762739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.762882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.763036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.763226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.763377 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.763528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.763672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.763827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.763970 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.764112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.764262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.764415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.764566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.764770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.764922 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.765343 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.765506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.765658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.765810 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.765971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.766122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.766266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.766408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.766550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.766704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.766928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.767074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.767216 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.767357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.767505 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.767650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.767800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.767943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.768093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.768236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.768377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.768543 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.769331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.769877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.770042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.770194 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.770346 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.770502 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.770652 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.770803 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.770953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.771103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.771247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.771247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.771247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.771666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.772089 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.772272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.772425 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.772570 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.772753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.772907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.773061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.773204 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.773397 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.773553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.773696 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.773864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.774018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.774162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.774303 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.774453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.774609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.774762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.774913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.775065 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.775226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.775648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.775793 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.775944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.776109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.776260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.776410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.776561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.776714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.776901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.777047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.777188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.777337 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.777486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.777643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.777787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.777936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.778094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.778236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.778377 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.778531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.778681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.778831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.778975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.779125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.779267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.779418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.779578 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.780032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.780196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.780348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.780492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.780644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.780837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.780984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.781126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.781268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.781421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:58:19.781579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.781722 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.781864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.781864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.782924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.783879 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.784028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.784202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.784417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.784593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.784806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.785983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786760 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.786910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.787986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788141 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.788937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.789245 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.789396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.789545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.789545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.790222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.790380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.790539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.790691 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.790847 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.791866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792519 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.792893 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.793045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.793227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.793615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.793924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.794871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.795022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.795022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.795313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.795471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.795938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.796915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.797975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798145 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.798916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.799079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.799334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.799506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.799666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.799824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.801916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802203 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802855 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.802947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803738 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.803917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804184 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.804987 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805258 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805606 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.805709 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806529 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.806957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.807925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808118 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.808938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809476 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.809936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.810937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.811898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812432 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.812976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813364 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.813974 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.814978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.815187 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.815283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.815511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.815655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.815876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.816295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.816477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.816643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.816837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.816993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817479 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.817938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.818861 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819488 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.819951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.820109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.820259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.820418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.820568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.820789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.821891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.822975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823589 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.823951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.824927 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825709 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.825859 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826484 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.826954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.827875 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828502 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.828864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829177 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.829935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830244 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830554 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.830850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.831039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.831917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.832905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.833919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.834931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835081 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.835869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.836175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.836472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.836633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.836832 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.836990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837152 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837469 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.837951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.838890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839820 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.839971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840119 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.840914 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841065 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.841997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.842934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.843098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.843248 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.843398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.843558 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844820 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.844982 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.845768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.846103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.846257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.846413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.846717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.846931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.847735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.848894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.849978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.850900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.851926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852203 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.852975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853126 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853764 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.853913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854436 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.854893 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.855881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856493 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.856990 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857311 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.857946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858419 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858568 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.858883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859502 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.859971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860426 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.860910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861715 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.861873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.862032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.862213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.862380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863064 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863217 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.863976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.864181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.864344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.864504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.864653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.864850 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865340 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.865961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.866110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.866271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.866421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.866577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.866879 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867361 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.867982 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868133 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868804 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.868969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.869128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.869286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.869445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.869604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.869762 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870498 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870691 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.870978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871613 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871774 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.871934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.872635 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.873897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874054 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.874908 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875834 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.875984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.876791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.877247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.877399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.877555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.877717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.877874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.878077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.878749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.878903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879210 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.879950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880108 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.880925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881572 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.881923 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882081 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882239 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.882867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883016 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883328 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.883936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884612 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884805 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.884963 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.885951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886273 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.886906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.887986 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888144 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.888966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889274 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889737 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.889900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.890898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.891964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.892930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.893987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894493 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.894977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.895899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:58:19.896356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.896356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.897243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.897243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.897553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.897711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.898021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.898333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.898763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.899082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.899398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.899729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.900058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.900389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.900700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.901041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.901357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.901688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.902026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.902343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.902666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.902979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.903310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.903642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.903962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.904291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.904729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.905070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.905388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.905716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.906050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.906363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.906675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.906992 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.907289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.907602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.907932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.908242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.908556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.908895 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.909212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.910001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.910331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.910674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.910994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.911333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.911660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.911994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.912335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.912652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.913014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.913334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.913650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.913964 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.914277 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.914630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.914946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.915275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.915617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.915956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.916273 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.916613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.916974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.917306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.917626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.917953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.918283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.918594 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.918906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.919224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.919534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.919845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.920156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.920471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.920823 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.921135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.921448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.921779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.922099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.922427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.922742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.923054 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.923372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.923676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.924024 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.924331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.924668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.926090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.926435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.926767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.927092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.927417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.927741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.928064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.928384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.928706 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.929046 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.929369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.929691 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.930016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.930562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.930898 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.931220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.931540 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.931859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.932181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.932498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.932842 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.933163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.933481 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.933865 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.934141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.934465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.934797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.935139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.935462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.935783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.936253 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.936410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.936793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.937113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.937424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.937746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.938111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.938375 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.938689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.939004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.939321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.939637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.939952 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.940267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.940647 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.941963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.942303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.942648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.942983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.943305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.943627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.943955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.944487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.944833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.945173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.945506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.945837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.946160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.946484 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.946818 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.947130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.947442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.947762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.948076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.948388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.948729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.949062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.949373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.949695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.950011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.950556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.950912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.951235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.951567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.951899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.952224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.952538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.952898 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.953212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.953524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.953844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.954164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.954472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.954783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.955100 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.955416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.955727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.956043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.956671 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.956837 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Registered counter for database nova_api Oct 03 15:58:19.957094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.957415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.957732 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.958051 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.958373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.958685 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.958999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.959312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.959624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.959944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.960257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.960664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.961004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.961323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.961689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.962007 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.962320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.962652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.962969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.963280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.963604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.963920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.964250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.964565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.964905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.965257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.965580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.966130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.966471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.966799 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.967139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.967478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.967791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.968103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.968416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.969031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.969353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.969670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.969985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.970302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.970618 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.970932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.971248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.971563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.972123 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.972879 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.973177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.973500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.974129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.974129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.974591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.974778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.975104 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.975427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.975753 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.976078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.976398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.976748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.977068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.977387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.977710 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.978031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:19.978168 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.978404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.978675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.979256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.979676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.980086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.980548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.980975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.981350 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.981688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.982012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.982345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.982665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.983002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.983360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.983698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.984030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.984341 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.984655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.984993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.985309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.985634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.985803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:19.985952 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.986262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.986573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.986890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.987198 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.988033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.988982 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.989302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.989622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.989937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.990250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.990562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.990872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.991183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.991494 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.991809 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.992118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.992428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.992754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.993065 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.993374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.993714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.994060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.994383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.994713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.995029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.995357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.995674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.996001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.996328 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.996652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.996993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.997335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.997644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.997959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.998276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.998586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.998900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.999216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.999550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:19.999882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.000194 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.000524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.000868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.001196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.001517 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.001832 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.002166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.002482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.002796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.003164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.004447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.004796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.005127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.005448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.005767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.006093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.006416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.006751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.007084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.007401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.007733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.008063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.008421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.008774 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.009131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.009467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.009789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.010105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.010417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:58:20.010662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:58:20.043967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.context [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3daa5e-fb60-4c09-9b5d-f502e7858b1c(cell1) {{(pid=120588) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 15:58:20.047993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:20.048473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:20.050692 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:20.051531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:20.051992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:20.054057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:20.056069 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Registered counter for database nova_cell0 Oct 03 15:58:20.060133 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Registered counter for database nova_cell1 Oct 03 15:58:20.067413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.069609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.074741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.075518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Registered counter for database nova_api Oct 03 15:58:20.077436 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.096627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.104656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.163944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.context [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3daa5e-fb60-4c09-9b5d-f502e7858b1c(cell1) {{(pid=120587) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 15:58:20.167919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:20.168397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:20.170044 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:20.170776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:20.171224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:20.173272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:20.176339 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Registered counter for database nova_cell0 Oct 03 15:58:20.180408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Registered counter for database nova_cell1 Oct 03 15:58:20.188940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.189718 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.196585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.198709 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.232236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Registered counter for database nova_cell0 Oct 03 15:58:20.240015 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.244421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.358189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Registered counter for database nova_cell0 Oct 03 15:58:20.366334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:58:20.371396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:58:20.576760 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:58:20.581559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:58:20.712075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:58:20.719665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:58:20.934186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:58:20.942095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-c740a2c5-f47e-4e2b-90cb-104a55c58749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:58:20.949001 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c1ddb919c0 pid: 120588 (default app) Oct 03 15:58:21.070803 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 15:58:21.077068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-15c1e36d-88fa-47c6-a0c0-ccab461e18ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 15:58:21.083275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1ddb919c0 pid: 120587 (default app) Oct 03 15:58:57.301809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:57.303390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:57.304757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:57.306085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:58.839649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb16463c-0bd3-49c9-9c68-31fbe7267d08 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Action: 'create', calling method: .version_select at 0x7f8175cfa550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1219675285"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:00.792553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb16463c-0bd3-49c9-9c68-31fbe7267d08 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.521268 Oct 03 15:59:00.804872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Oct 3 15:58:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3538 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 15:59:00.812076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:00.813508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:00.815061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:00.817905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:01.156703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44636c8b-f631-42bc-9b08-531e9ef58710 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175d44160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:01.602628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44636c8b-f631-42bc-9b08-531e9ef58710 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 200 len: 346 microversion: 2.1 time: 0.795569 Oct 03 15:59:01.603382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:00 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 346 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:01.616926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-558fb6a6-b738-4245-9708-46f8b22e7b83 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Action: 'create', calling method: .version_select at 0x7f8175bce3a0>, body: {"snapshot": {"volume_id": "fb280d25-1f83-4863-8638-300fd5fc8b1b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1169767698"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:02.148456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-558fb6a6-b738-4245-9708-46f8b22e7b83 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.535527 Oct 03 15:59:02.155479 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1162 bytes} [Mon Oct 3 15:59:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:02.163088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd07a78f-137a-4c94-a3ec-223375a08944 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175c0e3a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:02.377625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd07a78f-137a-4c94-a3ec-223375a08944 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 287 microversion: 2.1 time: 0.220913 Oct 03 15:59:02.378432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:02 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 287 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:02.389504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a50b69f9-9b20-4e2f-b8a6-9f8263ce04cb tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b65670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:02.451408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a50b69f9-9b20-4e2f-b8a6-9f8263ce04cb tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065514 Oct 03 15:59:02.458934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Oct 3 15:59:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:02.464267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f68f7c5d-a370-4a28-a14b-b3ecd8dec548 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175c0eaf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:02.504469 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f68f7c5d-a370-4a28-a14b-b3ecd8dec548 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 287 microversion: 2.1 time: 0.043995 Oct 03 15:59:02.505225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:02 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:03.518265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7475a1f2-4d54-49ea-9a3d-87c8c5b48542 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b65c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:03.575088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7475a1f2-4d54-49ea-9a3d-87c8c5b48542 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 287 microversion: 2.1 time: 0.061190 Oct 03 15:59:03.581386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:03 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:04.587582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c0878d8-6243-4b3b-aa6e-c7e6e9db306b tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175c0ed30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:04.667580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c0878d8-6243-4b3b-aa6e-c7e6e9db306b tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 287 microversion: 2.1 time: 0.083844 Oct 03 15:59:04.674468 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:04 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:05.682437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52220829-3dc2-43be-8d84-eb3cd54d77cf tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b654c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:05.766088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52220829-3dc2-43be-8d84-eb3cd54d77cf tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 288 microversion: 2.1 time: 0.088714 Oct 03 15:59:05.767019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:05 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:05.779178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45bfbf0d-454d-4f8a-99a5-e87ce12e156a tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175c0e550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:05.892417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45bfbf0d-454d-4f8a-99a5-e87ce12e156a tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 202 len: 0 microversion: 2.1 time: 0.117844 Oct 03 15:59:05.897270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Oct 3 15:59:05 2022] DELETE /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:59:05.903104 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2dd2ed72-f960-4a26-82f8-ccf95bbfe453 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175bcef70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:05.998426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2dd2ed72-f960-4a26-82f8-ccf95bbfe453 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 200 len: 287 microversion: 2.1 time: 0.100723 Oct 03 15:59:05.999446 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:05 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:07.012059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9801b979-3ec1-4705-8949-02404f2b29fa tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175bcf280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:07.040827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9801b979-3ec1-4705-8949-02404f2b29fa tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] HTTP exception thrown: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9801b979-3ec1-4705-8949-02404f2b29fa tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Request method failure captured: Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f HTTP/1.1 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbBJGGfTGaqrrEfp3PFUiOmavR-N87aicWttqiQt465pq7U6SkVfp175Ewvt04gK7-czV-sEbSrOg4Yj6jTmJkR7XcR2salg8eUoL0rOWByVyfORlOMSqkvI_HscHy8i1ZQUruZkuomo4zqhcjCfE_u-k7q5G8bkMwbLqWAK5DmZ0c Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 15:59:07.045161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/30034fca82444cca9b98bc6385adba43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_30034fca82444cca9b98bc6385adba43", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: fa9fce4427904e59847ac2081c999bcb Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'a175e522-2cd7-4c79-9b25-fee848cff98f'} Oct 03 15:59:07.046255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. (HTTP 404) (Request-ID: req-a36de9a2-fa0b-477f-983d-cbfcf9bce328) Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.046863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:07.047717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 15:59:07.048631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9801b979-3ec1-4705-8949-02404f2b29fa tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Returning 404 to user: Snapshot a175e522-2cd7-4c79-9b25-fee848cff98f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9801b979-3ec1-4705-8949-02404f2b29fa tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f" status: 404 len: 111 microversion: 2.1 time: 0.038692 Oct 03 15:59:07.051628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Oct 3 15:59:07 2022] GET /compute/v2.1/os-snapshots/a175e522-2cd7-4c79-9b25-fee848cff98f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:59:07.055780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1e13a6c-4337-49ca-b2b3-1bcabf0f6b4b tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b65310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:07.134512 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1e13a6c-4337-49ca-b2b3-1bcabf0f6b4b tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 202 len: 0 microversion: 2.1 time: 0.082341 Oct 03 15:59:07.135647 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 15:59:07 2022] DELETE /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:59:07.145966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df1eb3e2-7c02-4eb1-b71e-879d4405c580 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175bcfca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:07.273418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df1eb3e2-7c02-4eb1-b71e-879d4405c580 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 200 len: 345 microversion: 2.1 time: 0.133181 Oct 03 15:59:07.273987 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:07 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:08.289685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a92bfd03-2f6c-4d94-8dc0-60fab7f34da6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b65c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:08.397239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a92bfd03-2f6c-4d94-8dc0-60fab7f34da6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 200 len: 345 microversion: 2.1 time: 0.112540 Oct 03 15:59:08.398080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:08 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:09.415785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13c18326-2ea8-45a6-8be3-301bf70ae104 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b323a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:09.535057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13c18326-2ea8-45a6-8be3-301bf70ae104 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 200 len: 345 microversion: 2.1 time: 0.125922 Oct 03 15:59:09.535630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:09 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:10.434208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-602217128", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "networks": [{"uuid": "6729b450-3931-444e-a8de-cc935e69b64c"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:10.551745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e226b73-6c97-441b-955c-c4480a694bad tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175bcfca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:10.677458 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3e226b73-6c97-441b-955c-c4480a694bad tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] HTTP exception thrown: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e226b73-6c97-441b-955c-c4480a694bad tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Request method failure captured: Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b HTTP/1.1 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbBJGGfTGaqrrEfp3PFUiOmavR-N87aicWttqiQt465pq7U6SkVfp175Ewvt04gK7-czV-sEbSrOg4Yj6jTmJkR7XcR2salg8eUoL0rOWByVyfORlOMSqkvI_HscHy8i1ZQUruZkuomo4zqhcjCfE_u-k7q5G8bkMwbLqWAK5DmZ0c Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 15:59:10.685121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/30034fca82444cca9b98bc6385adba43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_30034fca82444cca9b98bc6385adba43", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: fa9fce4427904e59847ac2081c999bcb Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'fb280d25-1f83-4863-8638-300fd5fc8b1b'} Oct 03 15:59:10.686225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. (HTTP 404) (Request-ID: req-442370e0-3c67-4ea4-82ed-26bfbb7ec774) Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.686872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:10.687764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:59:10.688894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.689906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.693013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e226b73-6c97-441b-955c-c4480a694bad tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Returning 404 to user: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:59:10.694464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e226b73-6c97-441b-955c-c4480a694bad tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 404 len: 109 microversion: 2.1 time: 0.148789 Oct 03 15:59:10.702056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:10 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:59:10.722832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] validate_networks() for [('6729b450-3931-444e-a8de-cc935e69b64c', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:59:10.729555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ed15f90-2e85-48b3-9aaf-6503b7f339a6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175b32b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:10.816440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5ed15f90-2e85-48b3-9aaf-6503b7f339a6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] HTTP exception thrown: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ed15f90-2e85-48b3-9aaf-6503b7f339a6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Request method failure captured: Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b HTTP/1.1 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbBJGGfTGaqrrEfp3PFUiOmavR-N87aicWttqiQt465pq7U6SkVfp175Ewvt04gK7-czV-sEbSrOg4Yj6jTmJkR7XcR2salg8eUoL0rOWByVyfORlOMSqkvI_HscHy8i1ZQUruZkuomo4zqhcjCfE_u-k7q5G8bkMwbLqWAK5DmZ0c Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 15:59:10.818406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/30034fca82444cca9b98bc6385adba43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_30034fca82444cca9b98bc6385adba43", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: fa9fce4427904e59847ac2081c999bcb Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'fb280d25-1f83-4863-8638-300fd5fc8b1b'} Oct 03 15:59:10.819413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. (HTTP 404) (Request-ID: req-60660a77-4a05-4ee9-8592-e9309378f49c) Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.820045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 15:59:10.820958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 15:59:10.821845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ed15f90-2e85-48b3-9aaf-6503b7f339a6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Returning 404 to user: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ed15f90-2e85-48b3-9aaf-6503b7f339a6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 404 len: 109 microversion: 2.1 time: 0.112864 Oct 03 15:59:10.822693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 10/18] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 15:59:10 2022] DELETE /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:59:10.830127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c589cdde-3863-47af-9091-24da2f93efc6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Calling method '.version_select at 0x7f8175bcfca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:10.890877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c589cdde-3863-47af-9091-24da2f93efc6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] HTTP exception thrown: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c589cdde-3863-47af-9091-24da2f93efc6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Request method failure captured: Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b HTTP/1.1 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbBJGGfTGaqrrEfp3PFUiOmavR-N87aicWttqiQt465pq7U6SkVfp175Ewvt04gK7-czV-sEbSrOg4Yj6jTmJkR7XcR2salg8eUoL0rOWByVyfORlOMSqkvI_HscHy8i1ZQUruZkuomo4zqhcjCfE_u-k7q5G8bkMwbLqWAK5DmZ0c Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 15:59:10.893432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/30034fca82444cca9b98bc6385adba43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_30034fca82444cca9b98bc6385adba43", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/30034fca82444cca9b98bc6385adba43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 30034fca82444cca9b98bc6385adba43 Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158790477 Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: fa9fce4427904e59847ac2081c999bcb Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158790477-project Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'fb280d25-1f83-4863-8638-300fd5fc8b1b'} Oct 03 15:59:10.894926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. (HTTP 404) (Request-ID: req-6af3f7d4-f2c3-4414-a751-63065b5e0f44) Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.895708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:10.896988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:59:10.898070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c589cdde-3863-47af-9091-24da2f93efc6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] Returning 404 to user: Volume fb280d25-1f83-4863-8638-300fd5fc8b1b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c589cdde-3863-47af-9091-24da2f93efc6 tempest-VolumesSnapshotsTestJSON-158790477 tempest-VolumesSnapshotsTestJSON-158790477-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b" status: 404 len: 109 microversion: 2.1 time: 0.069213 Oct 03 15:59:10.899429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 11/19] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:10 2022] GET /compute/v2.1/os-volumes/fb280d25-1f83-4863-8638-300fd5fc8b1b => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:59:13.716380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:59:13.717095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:59:13.717990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:59:13.718878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:59:13.719604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:59:13.758012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:13.758497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:13.758928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:13.759634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:13.766285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:13.766953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:13.838004 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Getting quotas for project 943f7e5ccad5410896a40678aeaaf1c1. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:13.842610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Getting quotas for user 105c6710d8994b0c9a1b66c4dad6dbc8 and project 943f7e5ccad5410896a40678aeaaf1c1. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:13.869660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:59:13.872844 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:59:14.121580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0931764f-f26d-4073-92c6-b004914b95f2 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.991080 Oct 03 15:59:14.124114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 9/20] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 15:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:59:14.137631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56af35a4-5735-4bf1-826d-7b424f302f72 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:14.139075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56af35a4-5735-4bf1-826d-7b424f302f72 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:14.413276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-56af35a4-5735-4bf1-826d-7b424f302f72 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:14.437245 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56af35a4-5735-4bf1-826d-7b424f302f72 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1214 microversion: 2.1 time: 0.304209 Oct 03 15:59:14.437817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 12/21] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:14 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:15.464500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01ecfca5-1710-41ab-9acd-b69b5a7c1b1f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:15.465176 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01ecfca5-1710-41ab-9acd-b69b5a7c1b1f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:15.841639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-01ecfca5-1710-41ab-9acd-b69b5a7c1b1f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:15.850961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01ecfca5-1710-41ab-9acd-b69b5a7c1b1f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1214 microversion: 2.1 time: 0.390721 Oct 03 15:59:15.852440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 13/22] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:15 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1214 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:16.115114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd45fe64-567f-4827-9e3c-f750f3e7f523 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: .version_select at 0x7f817527d4c0>, body: {"keypair": {"name": "tempest-keypair-810370027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC34Uom5dGoxte3SthQR432wFhLQCRCdk99+SWTL/Wke/unGuZVwaCmZg32dhaFPD0R/LMyoBCWj+/nE+MjNML9g10/CcqXYbnIL+7TTQS9GqHlUIuggn/tjcvtEIHoQOg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:16.212368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-cd45fe64-567f-4827-9e3c-f750f3e7f523 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:16.223629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-cd45fe64-567f-4827-9e3c-f750f3e7f523 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for user 73a1aa0996db4c8ea851b2ba45026b35 and project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:16.400985 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd45fe64-567f-4827-9e3c-f750f3e7f523 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.950795 Oct 03 15:59:16.403292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 10/23] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 15:59:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:16.883744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb62482c-97d4-42c4-b817-6de5403f0bf4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:16.885406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb62482c-97d4-42c4-b817-6de5403f0bf4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:17.024623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb62482c-97d4-42c4-b817-6de5403f0bf4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:17.034240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb62482c-97d4-42c4-b817-6de5403f0bf4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1214 microversion: 2.1 time: 0.160284 Oct 03 15:59:17.040763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 14/24] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:16 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:17.778057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43681a5d-ef7d-4d3d-a84f-0acfa60c7e23 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Action: 'create', calling method: .version_select at 0x7f817528b0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1677594066", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:18.058632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:18.059523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:18.071680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:18.074329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:18.074836 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:18.075568 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:18.079530 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:18.080342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:18.573309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43681a5d-ef7d-4d3d-a84f-0acfa60c7e23 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.691311 Oct 03 15:59:18.574662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 11/25] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 15:59:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1695 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 15:59:18.942260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:18.979568 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5c5c94d-fbaa-40c5-b9b7-3f81d5825067 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1266 microversion: 2.1 time: 0.914157 Oct 03 15:59:18.980227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 15/26] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:18 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1266 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:19.009490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc8487f3-44a5-4b5c-bb46-98026cd4b4c5 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Calling method '.version_select at 0x7f8175a74f70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:19.144361 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc8487f3-44a5-4b5c-bb46-98026cd4b4c5 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8" status: 200 len: 354 microversion: 2.1 time: 0.159673 Oct 03 15:59:19.146061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 16/27] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:18 2022] GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:19.473168 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823631620", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:19.659268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] validate_networks() for [('8944939a-3352-4658-bad6-12912f50f635', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:59:19.852367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7cb7a0e-7276-4003-bf24-6c86b72027b8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: .version_select at 0x7f8175a805e0>, body: {"keypair": {"name": "tempest-keypair-1532459905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8yRNfa9SSMu6mqKmpcuIywyOMV4A6NXO00xMfoLP6Irm4kjD1L6tALlXlb9Ymn3BD+lixyMwKi2UFcAPzX1e6YvKkBX/PirVzDqPi0YM+xxAInHSQ7EUJgCoXymNoIA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:19.979231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a7cb7a0e-7276-4003-bf24-6c86b72027b8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:19.996595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a7cb7a0e-7276-4003-bf24-6c86b72027b8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for user 5e113c9ec968460ba070cfc1a69a25a1 and project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:20.098975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7cb7a0e-7276-4003-bf24-6c86b72027b8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.950412 Oct 03 15:59:20.099978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 17/28] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Oct 3 15:59:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 953 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 15:59:20.104980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1907f40-412d-4855-a556-726ee44fdaf1 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Calling method '.version_select at 0x7f81759aadc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:20.236600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1907f40-412d-4855-a556-726ee44fdaf1 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8" status: 200 len: 354 microversion: 2.1 time: 0.134896 Oct 03 15:59:20.237322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 18/29] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:20 2022] GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:20.242029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:20.242712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:20.262705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:20.264824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:20.269127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:20.270249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:20.271107 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:20.271741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:20.448907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:20.462789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a5dcf37-efc9-4362-8489-88163c712393 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1272 microversion: 2.1 time: 0.224352 Oct 03 15:59:20.463617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 19/30] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:20 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:20.473957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1c36f65f-333a-483f-81d7-12b45e9c2953 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Calling method '.version_select at 0x7f81759dac10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:20.635290 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1c36f65f-333a-483f-81d7-12b45e9c2953 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8" status: 202 len: 0 microversion: 2.1 time: 0.169314 Oct 03 15:59:20.641371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 20/31] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 15:59:20 2022] DELETE /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:59:20.649700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ae98e4-cb2e-443f-8c51-33c2e69ebb96 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Calling method '.version_select at 0x7f81759aa8b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:20.858316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35ae98e4-cb2e-443f-8c51-33c2e69ebb96 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8" status: 200 len: 353 microversion: 2.1 time: 0.215587 Oct 03 15:59:20.860640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 21/32] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:20 2022] GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:21.396402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1154302632", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b631aad-5777-4efa-a0a0-1b5b5e7e2d32"}], "security_groups": [{"name": "tempest-securitygroup--1185600545"}], "key_name": "tempest-keypair-810370027", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:21.425059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:59:21.426050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:59:21.426050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:59:21.426521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:59:21.426790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:59:21.458874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:21.459419 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:21.459885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:21.460615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:21.461110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:21.461538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:21.593795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:21.623776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for user b3098a7103d94b29bc4bce30cfd05bc6 and project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:21.674631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:59:21.676893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:59:21.909202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c69860b-fce3-41ba-a6a4-ffc4ac511d7c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.332964 Oct 03 15:59:21.923635 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 12/33] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 15:59:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:59:21.939982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:21.940610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:22.007549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:22.008052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:22.015081 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:22.017480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:22.020705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:22.021223 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:22.274987 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] validate_networks() for [('1b631aad-5777-4efa-a0a0-1b5b5e7e2d32', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:59:23.619424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:23.676912 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76aebaa6-ba63-4d5a-9790-46f51d72cdbb tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 1.752038 Oct 03 15:59:23.677512 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 13/34] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:21 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:23.724588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05eca784-3b30-455f-9283-03d19c1d61b4 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Calling method '.version_select at 0x7f81751b4b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:23.837047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-05eca784-3b30-455f-9283-03d19c1d61b4 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] HTTP exception thrown: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05eca784-3b30-455f-9283-03d19c1d61b4 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Request method failure captured: Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 HTTP/1.1 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbUQsVOpziF9EXXNGIJYn34JFWQBoemzasOrmTVTcldqnTC3R9wwh5upzqvlBWMFXWtOFq09znOqBOtYshPRbuDxGacOS-Sb-waCWOee7Tw1WOwNjcU03Bp4tYpZHhsXGkGxokZi38zA9922XQw59zlAeCmfCiXcDgn7UEk5WaOcSU Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: ca133ddf3c61490093232365a8555999 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesGetTestJSON-110936466 Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 15:59:23.841304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca133ddf3c61490093232365a8555999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca133ddf3c61490093232365a8555999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca133ddf3c61490093232365a8555999", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca133ddf3c61490093232365a8555999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesGetTestJSON-110936466 Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: ca133ddf3c61490093232365a8555999 Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesGetTestJSON-110936466 Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesGetTestJSON-110936466-project Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: aaafa02a240c4d389288dcfc7aefb471 Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesGetTestJSON-110936466-project Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'e6d121ee-e503-40e7-8b8a-4cd073296de8'} Oct 03 15:59:23.842511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. (HTTP 404) (Request-ID: req-5cf136c0-d43c-4576-b181-cd84f4acf06e) Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:23.843600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:59:23.844979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:59:23.846031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05eca784-3b30-455f-9283-03d19c1d61b4 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] Returning 404 to user: Volume e6d121ee-e503-40e7-8b8a-4cd073296de8 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05eca784-3b30-455f-9283-03d19c1d61b4 tempest-VolumesGetTestJSON-110936466 tempest-VolumesGetTestJSON-110936466-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8" status: 404 len: 109 microversion: 2.1 time: 0.141157 Oct 03 15:59:23.847013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 14/35] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 15:59:23 2022] GET /compute/v2.1/os-volumes/e6d121ee-e503-40e7-8b8a-4cd073296de8 => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:59:23.871583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47f1efec-261f-4faa-b740-3af7efb1f955 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:23.872211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47f1efec-261f-4faa-b740-3af7efb1f955 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:24.576686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-47f1efec-261f-4faa-b740-3af7efb1f955 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:24.627627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47f1efec-261f-4faa-b740-3af7efb1f955 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1221 microversion: 2.1 time: 0.782618 Oct 03 15:59:24.642939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 15/36] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:23 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1221 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:24.703449 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:24.704568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:24.721330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:24.729362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:24.732980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:24.736504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:24.749560 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:24.758545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:26.897551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:26.910196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b311fd90-9f58-48ed-8a72-5961ccd5b2a5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 2.210507 Oct 03 15:59:26.927188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 16/37] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:24 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:26.938508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:59:26.939592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:59:26.940508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:59:26.941317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:59:26.942025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:59:26.944571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1658244160", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:26.988910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:26.994170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:26.995299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:26.998591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:27.003343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:27.006982 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:27.095734 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:27.107155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for user 73a1aa0996db4c8ea851b2ba45026b35 and project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:27.150806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:59:27.161412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:59:27.392425 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a12c74da-ab36-4250-b627-14737a5c5431 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.996474 Oct 03 15:59:27.396817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 22/38] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 15:59:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 6006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:59:27.435848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d7a7506-d6ee-484e-9246-72f4caeaa3d9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:27.435848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d7a7506-d6ee-484e-9246-72f4caeaa3d9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:27.681479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d7a7506-d6ee-484e-9246-72f4caeaa3d9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:27.696534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d7a7506-d6ee-484e-9246-72f4caeaa3d9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1237 microversion: 2.1 time: 0.287386 Oct 03 15:59:27.697360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 23/39] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:27 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1237 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:27.905734 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1129374767", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90c6b009-4013-4301-b819-4e12c2de8610"}], "security_groups": [{"name": "tempest-securitygroup--1909503443"}], "key_name": "tempest-keypair-1532459905", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:31.538890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:34.585401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=18 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:35.871415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] validate_networks() for [('8944939a-3352-4658-bad6-12912f50f635', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:59:35.999235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] validate_networks() for [('90c6b009-4013-4301-b819-4e12c2de8610', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:59:36.841878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:59:36.842500 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:59:36.843571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:59:36.844935 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:59:36.845486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:59:36.861403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.861901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.862342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:36.863074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.863529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.866625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:36.884359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:59:36.885209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:59:36.885311 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:59:36.885676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:59:36.886629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:59:36.888828 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:36.894148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for user b3098a7103d94b29bc4bce30cfd05bc6 and project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:36.901305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.901666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.902183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:36.902917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.903375 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.903806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:36.906082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:59:36.909042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:59:36.942050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:59:36.954726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for user 5e113c9ec968460ba070cfc1a69a25a1 and project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:59:36.969731 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:59:36.972214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:59:36.973036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7432c246-9b22-4bcc-af52-2236e1ee8a03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 10.044257 Oct 03 15:59:36.974050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 17/40] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 15:59:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 10046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:59:36.980277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:36.981283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:36.992972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.993593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.994338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:36.995156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:36.995761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:36.996288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.057320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5550c43-722f-4529-a649-1647d6763508 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 9.158516 Oct 03 15:59:37.057983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 24/41] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Oct 3 15:59:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 9161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 15:59:37.080925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:37.083139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:37.102536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.103330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.103780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.104495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.105108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.105707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.195442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:37.207000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3990644-b661-4574-841c-b09f0d50f147 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.227912 Oct 03 15:59:37.208095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 18/42] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:36 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:37.354699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:37.363415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d52cf11a-2f38-4933-a822-cbfcadda4de6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.294755 Oct 03 15:59:37.382800 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 25/43] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:37 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:37.630202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597", "tag": "d98370fa-9fb9-4a61-b4bb-53554447eae1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:37.657353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.658139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.658872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.680861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Creating event network-changed:d98370fa-9fb9-4a61-b4bb-53554447eae1 for instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 on hv-cinder-84456 Oct 03 15:59:37.681467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 15:59:37.682030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d68b5bf-186a-41a0-8586-602941d79ab9 req-0d332db8-2c16-494a-8fbc-39c0c1815f83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 15:59:37.683371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.684126 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.684682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.685625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.686268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.686877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.699717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.compute.rpcapi [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 15:59:37.701061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] Releasing lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 15:59:37.711088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a24b8d-f733-4d00-8cbd-5f211f9ef68e", "tag": "d710284d-cf34-4ba0-b620-3fcbf1bcd02b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:37.739602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3f17e3d-ed9e-4d2b-b594-46e084fb412c None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515142 Oct 03 15:59:37.742179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 19/44] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:37.747123 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.747626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.749552 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.763084 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aaac6458-0685-477f-a0b0-c028fd4757ae tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:37.763809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aaac6458-0685-477f-a0b0-c028fd4757ae tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:37.819249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Creating event network-changed:d710284d-cf34-4ba0-b620-3fcbf1bcd02b for instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e on hv-cinder-84456 Oct 03 15:59:37.822516 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 15:59:37.824421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a89090-aada-45ef-bcd3-8d8146e3f32e req-46a37c6d-9b10-4825-8c75-994aff92df01 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 15:59:37.829348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.831030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.831855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.834748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.835470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.836485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.854748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.compute.rpcapi [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 15:59:37.855666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] Releasing lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 15:59:37.885596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc4071b6-a569-446e-94b7-879a242e5a08 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501371 Oct 03 15:59:37.887555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 26/45] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:37.895078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:37.896279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:37.908373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.908943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.909839 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.910740 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:37.911364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:37.911836 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:37.948071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aaac6458-0685-477f-a0b0-c028fd4757ae tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:37.966123 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aaac6458-0685-477f-a0b0-c028fd4757ae tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1222 microversion: 2.1 time: 0.218810 Oct 03 15:59:37.966907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 20/46] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:37 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:38.028784 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:38.040428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:38.042972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:38.044566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-717389fa-dcb9-4fdd-b7e2-17590d02ed76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1286 microversion: 2.20 time: 0.155426 Oct 03 15:59:38.046108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 27/47] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:37 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:38.232237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:38.233381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:38.241497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:38.242360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:38.242477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:38.243132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:38.243592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:38.244021 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:38.286990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=29 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:38.395045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:38.396927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:38.416574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:38.417115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:38.417557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:38.418269 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:38.418724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:38.419161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:38.600405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:38.608298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f779e90-dd2c-498d-8948-a4d4fe3aeb58 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.380653 Oct 03 15:59:38.625067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 21/48] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:38 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:38.876149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:38.887117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03c09bfa-e300-4120-8a4e-5bf978223a0d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.496473 Oct 03 15:59:38.887763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 28/49] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:38 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:38.992359 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:38.993130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:38.996911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:39.009292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.010096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.010742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.011734 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.012472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.013010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.073333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:39.074224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:39.080362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.081143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.081717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.082567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.083016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.083577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.090526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:39.104362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b62309ae-df6e-4e70-9bfa-18f2f29bb41b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1218 microversion: 2.1 time: 0.117213 Oct 03 15:59:39.106945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 22/50] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:38 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:39.197409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:39.209329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:39.211504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:39.212868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-036140b6-c47d-47a5-9ede-5866d60d46e9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1334 microversion: 2.20 time: 0.143351 Oct 03 15:59:39.225418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 29/51] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:39 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:59:39.634706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:39.635408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:39.642249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.642758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.643190 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.643979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.644436 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.644885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.757248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7100bc2d-5133-4f37-a224-1eba62ee2aab", "tag": "cc1af7f2-81c4-4fc8-858e-39dbf9a276f6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:39.768902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.769933 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.770518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.784120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] Creating event network-changed:cc1af7f2-81c4-4fc8-858e-39dbf9a276f6 for instance 7100bc2d-5133-4f37-a224-1eba62ee2aab on hv-cinder-84456 Oct 03 15:59:39.789454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-840d3bba-ad1f-45cf-92ce-92e104c1acee req-5439db8f-7abf-4662-895d-08c17fe2a125 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036047 Oct 03 15:59:39.790684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 30/52] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:39.800230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:39.810057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0af7c4d-ab45-4468-ad69-5594f29b4cac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.181542 Oct 03 15:59:39.811174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 23/53] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:39 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:39.912230 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:39.912957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:39.924857 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.925518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.926113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:39.927132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:39.927728 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:39.928306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.074506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:40.083289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83e6499f-0692-4e25-bd09-e13210e8a55a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.175169 Oct 03 15:59:40.083882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 31/54] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:39 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:40.131724 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:40.132767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:40.139451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.139948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.140988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.141971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.142598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.143030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.215371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:40.223379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f3d08e9-245e-4d5f-81b6-79a37ec583c5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1218 microversion: 2.1 time: 0.096699 Oct 03 15:59:40.225457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 24/55] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:40 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:40.241407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:40.242768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:40.261358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.264005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.264677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.269336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.270025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.270617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.352381 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:40.363876 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:40.365427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:40.366773 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39ad1272-26aa-4f89-860a-5321f8f0386c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1334 microversion: 2.20 time: 0.129665 Oct 03 15:59:40.381789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 32/56] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:40 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:40.834068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:40.834982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:40.841691 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.842175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.842607 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.844508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:40.845164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:40.845885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:40.989996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.003145 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7591c4b1-3f80-4194-8002-5079ec4288d0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.172816 Oct 03 15:59:41.003864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 25/57] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:40 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:41.112255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:41.113742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:41.131214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.133220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.133876 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.134868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.135642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.136395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.252427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:41.253767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:41.264482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.265159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.265758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.266476 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.266929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.269093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.374155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.384227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bcc9089-4f25-40a1-b49a-8103c964db5b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1218 microversion: 2.1 time: 0.138202 Oct 03 15:59:41.385374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 26/58] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:41 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:41.403144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:41.405172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:41.412499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.416194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.416690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.417143 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.417889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:41.418289 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:41.418947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:41.423432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86ce4da2-a6c6-4e7c-a12a-e1cf3f984ebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.319085 Oct 03 15:59:41.425386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 33/59] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:41 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:41.500059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.513838 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.516202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:41.517537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92156a1f-dd59-44ec-b290-26a5c26eac54 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1334 microversion: 2.20 time: 0.121641 Oct 03 15:59:41.518248 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 27/60] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:41 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:42.031946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:42.032575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:42.052607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.053413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.054301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.055751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.057998 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.059937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.409756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:42.411042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:42.421215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.422688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.453287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.454861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.455555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.456465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.465165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:42.476178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1227d98-6d53-49fc-b452-1ae0af52fe8b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.448955 Oct 03 15:59:42.489799 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 34/61] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:42 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:42.506257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:42.510297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:42.529507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.533664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.536156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.539367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.542746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.544180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.708706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:42.717610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-79a2f76a-2d7b-4116-9427-364a070c47a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1218 microversion: 2.1 time: 0.313804 Oct 03 15:59:42.725966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 28/62] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:42 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1218 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:42.741469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:42.743061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:42.767625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.771438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.772177 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:42.773524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:42.777326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:42.777972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.018224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:43.028767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04b3d11d-e0c6-43ec-9951-ae73ec0a30f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.533037 Oct 03 15:59:43.032416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 35/63] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:42 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:43.037443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:43.063108 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:43.068830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:43.074810 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27c4b252-f759-46a4-a101-05597842059e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1352 microversion: 2.20 time: 0.342910 Oct 03 15:59:43.076150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 29/64] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:42 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1352 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:43.506423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:43.507187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:43.521297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:43.521512 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:43.523216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.526982 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:43.527475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:43.527920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.844580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7100bc2d-5133-4f37-a224-1eba62ee2aab", "name": "network-vif-plugged", "status": "completed", "tag": "cc1af7f2-81c4-4fc8-858e-39dbf9a276f6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:43.864923 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:43.865568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:43.868125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.895603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] Creating event network-vif-plugged:cc1af7f2-81c4-4fc8-858e-39dbf9a276f6 for instance 7100bc2d-5133-4f37-a224-1eba62ee2aab on hv-cinder-84456 Oct 03 15:59:43.919526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-79f167ce-873a-41b0-b440-fe1d4ccaa626 req-25e504a2-ac3c-4aca-b8a1-e4d3c9ecc40a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173723 Oct 03 15:59:43.920754 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 30/65] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:43.930973 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:43.931695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:43.949758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:43.950653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:43.955609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.964095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:43.964948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:43.965938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:43.974581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.011144 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-111fe9ff-1270-4e0a-9916-e330f9fabaac tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.509721 Oct 03 15:59:44.012416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 36/66] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:43 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:44.052834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:44.053399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:44.065510 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:44.065995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:44.066427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:44.067121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:44.067589 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:44.067995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:44.127186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.135726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2e6c7b8-a5e6-466d-abec-f45741096f0d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1280 microversion: 2.1 time: 0.213259 Oct 03 15:59:44.136312 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 31/67] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:43 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:44.142858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:44.143471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:44.149817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:44.150466 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:44.150907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:44.152208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:44.152667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:44.153164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:44.251185 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.260979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.262499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.263800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9252711b-0603-4d5f-b0b2-15d329c63632 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1340 microversion: 2.20 time: 0.126370 Oct 03 15:59:44.264358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 32/68] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:44 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1340 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:44.296034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:44.299359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=87 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:44.314048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e943778d-5b60-45af-8c0e-7764b45543d2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.266442 Oct 03 15:59:44.314890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 37/69] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:44 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:45.041117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:45.041922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:45.049283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.050377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.051171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.051977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.052435 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.053244 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.169059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:45.170333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:45.173408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:45.179565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.180287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.180927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.181707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.182393 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.183060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.240484 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.259798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23a01277-e85a-4e97-afad-bd326a4e7f19 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.222414 Oct 03 15:59:45.260387 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 33/70] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:45 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:45.275059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.283716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d66ef55-c47f-45fc-bb0f-2fb5ac15fd5c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1280 microversion: 2.1 time: 0.127545 Oct 03 15:59:45.289086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 38/71] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:45 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:45.295558 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:45.297301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:45.309351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.309829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.310256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.310943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.311379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.311787 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.340164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:45.340693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:45.347940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.348644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.349260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.350106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.350746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.351352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.376658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.386313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.388255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.389593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a5104ef-f57c-4720-94ae-f34f2241cd78 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1340 microversion: 2.20 time: 0.098372 Oct 03 15:59:45.390809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 34/72] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:45 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:59:45.500478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:45.508423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-604c1b15-0792-4ccd-a689-2a06833aa5cc tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.171861 Oct 03 15:59:45.509006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:45 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:45.948870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597", "name": "network-vif-plugged", "status": "completed", "tag": "d98370fa-9fb9-4a61-b4bb-53554447eae1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:45.959945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:45.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:45.960937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:45.976335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] Creating event network-vif-plugged:d98370fa-9fb9-4a61-b4bb-53554447eae1 for instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 on hv-cinder-84456 Oct 03 15:59:45.982508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-685f138e-562f-4c65-9e3f-4499402f5057 req-5f037576-1eca-45b2-98fc-9c2db536000a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038451 Oct 03 15:59:45.983152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 35/74] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:46.294346 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:46.294934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:46.310083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:46.311025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:46.317281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.318001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.318627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.319724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.320486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.321106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.327172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.328415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.329111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.330025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.330683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.331288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.443885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.452103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27810598-87c6-4f0e-b7b9-1e38c2d57de5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1280 microversion: 2.1 time: 0.146298 Oct 03 15:59:46.453167 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 36/75] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:46 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:46.458395 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:46.458995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:46.465288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.465770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.466198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.466874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.467318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.467729 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.518150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.525927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24f3f82f-5c4b-4fad-bbc8-c5003022659c tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.236776 Oct 03 15:59:46.532792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 40/76] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:46 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:46.532792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:46.532792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:46.536799 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.538545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.539196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.539631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.540324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:46.540798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:46.541221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:46.545261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.546734 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.548017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-421c5725-0749-4fdb-9801-64120bc781b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1340 microversion: 2.20 time: 0.093628 Oct 03 15:59:46.548565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 37/77] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:46 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:46.767323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:46.785222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff959765-89ff-46f5-b26c-4848f1c044f1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.257288 Oct 03 15:59:46.795311 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 41/78] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:46 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:47.477537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:47.478156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:47.491225 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:47.496638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:47.499579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:47.502555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:47.503269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:47.504251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:47.553327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:47.554949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:47.566914 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:47.569813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:47.570964 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:47.574785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:47.578252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:47.579318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:47.581101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:47.707556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:47.853605 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:47.957263 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:48.148797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.178455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-578203e2-3b28-4b33-8d97-cad4ea64a796 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.633319 Oct 03 15:59:48.179052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 42/79] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:47 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:48.183996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:48.185655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:48.198631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:48.199142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:48.199611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:48.204944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:48.205489 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:48.205931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:48.316831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.324508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad30641f-7f3a-44ef-9126-a9ffb0d55ccb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.851536 Oct 03 15:59:48.325119 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 38/80] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:47 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:48.344043 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:48.345379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:48.367945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:48.369726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:48.371071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:48.373020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:48.375630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:48.385124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:48.397089 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:48.518080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.527506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.539030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.542138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb136510-f75f-45a6-9f8a-6e71f0330842 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.360625 Oct 03 15:59:48.553506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 43/81] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:48 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:48.553506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a24b8d-f733-4d00-8cbd-5f211f9ef68e", "name": "network-vif-plugged", "status": "completed", "tag": "d710284d-cf34-4ba0-b620-3fcbf1bcd02b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:48.563353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:48.563876 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:48.564321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:48.578202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] Creating event network-vif-plugged:d710284d-cf34-4ba0-b620-3fcbf1bcd02b for instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e on hv-cinder-84456 Oct 03 15:59:48.583856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e095c455-1aab-4f24-85ff-9e3f08aabfb0 req-af906f23-00cf-4c02-bcfe-dae598aa19b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Oct 03 15:59:48.584451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 44/82] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:48.748492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:48.759803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-760449c3-f6f3-4208-aace-598000450ff4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.433393 Oct 03 15:59:48.760394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 39/83] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:48 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:49.065251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:49.117108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.127855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.128452 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.179724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] Creating event network-changed:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 15:59:49.192404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0d13be12-d6a2-425a-be74-d71c1ea709f7 req-469dba76-c0e6-4afe-b585-b8fd41d9283f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131857 Oct 03 15:59:49.193294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 45/84] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:49.205477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:49.206109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:49.223125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.223644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.224085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.224915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.225570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.225996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.355254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:49.356730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:49.383087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.383587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.384164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.385208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.385667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.386451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.612315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:49.639556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa87cdd9-f81e-4f42-af73-62798e8a8641 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.438754 Oct 03 15:59:49.653014 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 40/85] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:49 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:49.661381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5788363a-33d3-4304-a1eb-ff548eff183c", "tag": "49490488-b358-414a-b2e8-87117b319960"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:49.676026 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.676645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.677363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.683846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:49.692385 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] Creating event network-changed:49490488-b358-414a-b2e8-87117b319960 for instance 5788363a-33d3-4304-a1eb-ff548eff183c on hv-cinder-84456 Oct 03 15:59:49.693895 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a57f7495-23a3-4775-bc27-40530f2db9ff tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.348891 Oct 03 15:59:49.694991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 46/86] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:49 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:49.698085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-98fc0e94-0f54-4010-a796-93cab1e3e6da req-16035062-e596-41e4-8677-8d0aa713e6a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040240 Oct 03 15:59:49.699551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 41/87] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:49.714656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:49.715281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:49.722860 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.723345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.723782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.724486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.724959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.725545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.785741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:49.787451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:49.794448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.795662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.796885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.799046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:49.799741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:49.800502 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:49.924233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:49.939366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:49.943748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:49.945038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d005ce19-0eb9-4346-baf4-de88ac2f172b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.248834 Oct 03 15:59:49.946037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 47/88] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:49 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:50.028061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:50.038011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fcf9e9c-ba66-4517-b9a8-a348adb977cd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.256925 Oct 03 15:59:50.040758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 42/89] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:49 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:50.666491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:50.667212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:50.674015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.674847 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.675345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:50.676058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.676534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.676983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:50.720954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:50.721600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:50.728295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.728801 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.729247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:50.729921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.730370 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.730792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:50.884893 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:50.894165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7f17901-750c-445c-9ccc-8b215ffd00e4 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.231564 Oct 03 15:59:50.904796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 48/90] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:50 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:50.915699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:50.924352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0099b44-13f7-45f0-bb12-d4caec9e9a92 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.209520 Oct 03 15:59:50.925160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 43/91] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:50 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:50.974974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:50.976092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:50.984522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.985114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.985443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:50.986128 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:50.986569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:50.986983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.064287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:51.065581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:51.073751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.074465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.075050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.076087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.076576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.077031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.147357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:51.166457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:51.168185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:51.170141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9bba1f12-ec96-450c-a31f-98d41e0f009e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.199400 Oct 03 15:59:51.170906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 49/92] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:50 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:51.243051 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:51.251604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a4cdfe5-4e10-41f6-b6ed-b6667baa5d4b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.192617 Oct 03 15:59:51.252292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 44/93] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:51 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:51.918127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:51.918733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:51.925281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.925763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.926220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.926911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.927360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.927787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.947738 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:51.948434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:51.955024 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.955693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.956399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:51.957354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:51.958013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:51.958641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:52.150093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.163052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c101df4-0ef0-4d9d-82d9-120cd0dc9fd7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.248573 Oct 03 15:59:52.163209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.175331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d684ba03-27a1-470e-9c2a-6d9611410c5f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.231322 Oct 03 15:59:52.176999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 45/94] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:51 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:52.178639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 50/95] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:51 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:52.196759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:52.197610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:52.205831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:52.206880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:52.207633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:52.208294 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:52.209035 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:52.209460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:52.274208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:52.274817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:52.281546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:52.282037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:52.282467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:52.283149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:52.283597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:52.284021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:52.369930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.378886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.380336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.381462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b523f97f-d19e-4b3c-987e-8aad8793e539 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.190059 Oct 03 15:59:52.382010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 46/96] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:52 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:52.429828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:52.437967 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1f8e534-21b5-441c-a323-3974b095968c tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.167701 Oct 03 15:59:52.438534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 51/97] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:52 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:53.189494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:53.190138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:53.196278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.196794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.197298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.198120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.198508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.199103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.202819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:53.205151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:53.222077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.222968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.223710 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.224468 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.225169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.225730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.525574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:53.539448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c4f1200-e6d7-497e-9cbf-def8da0fe73f tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1314 microversion: 2.1 time: 0.354069 Oct 03 15:59:53.548811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 47/98] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:53 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:53.558606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:53.560294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f857694-acb0-4ae7-acd3-0a4c5c09f38c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.364439 Oct 03 15:59:53.563010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:53.563603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:53 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:53.564346 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:53.570894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.571630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.572053 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.572758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.573204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.573611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.577250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:53.578830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:53.585150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.585776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.586313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.587112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:53.587684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:53.588206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:53.957920 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:53.972389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:53.982485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:53.983883 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a165a14-b582-46ce-a047-4a19db3ca3d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.432849 Oct 03 15:59:53.984447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 48/100] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:53 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:53.991523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:54.005709 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f44c9a9-a5bf-47ca-a7ad-ebac8cff092b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.440770 Oct 03 15:59:54.009481 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 53/101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:53 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:54.567378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:54.568152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:54.575475 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:54.576668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:54.577331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:54.578488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:54.579044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:54.579726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:54.589556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:54.591454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:54.609916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:54.610562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:54.611013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:54.611716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:54.612170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:54.612586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:54.835775 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:54.847636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15c6fa8e-2ed2-4c10-824c-ebb495a7107d tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1502 microversion: 2.1 time: 0.284785 Oct 03 15:59:54.848186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:54.857090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91855b1a-0f87-44fd-999e-67a8085f32cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.272314 Oct 03 15:59:54.858010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 54/102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:54 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:54.860644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 49/103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:54 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:55.011709 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:55.012432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:55.019608 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.020306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.020932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:55.021778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.022241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.022665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:55.038626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:55.039497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:55.048014 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.048743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.049361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:55.050602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.051328 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.051940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:55.277493 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:55.280062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:55.292677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:55.297561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:55.299401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:55.300828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-154c0594-1502-4d16-861b-4796b69f0c05 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.294064 Oct 03 15:59:55.301642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 55/104] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:55 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:59:55.321611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff126cb3-b22e-4818-8071-f515033763f4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1363 microversion: 2.1 time: 0.287597 Oct 03 15:59:55.322582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 50/105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:55 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:55.881680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:55.883027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:55.893450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.893962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.894401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:55.895110 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:55.896001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:55.898263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.121102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:56.130786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9195f189-8e3b-47dd-b0ca-c1fbdc4ae711 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.252802 Oct 03 15:59:56.131366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 56/106] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:55 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:56.317598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ef0645-de34-4be4-8f87-44b163c8c84f"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:56.320036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:56.326621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.327114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.328124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.328257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:56.328875 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.329320 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.329421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:56.329742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.335471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.336105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.338188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.338903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.339515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.340112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.486648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:56.495979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:56.497960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:56.499763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-364ad54d-bb97-43ef-bd30-e263e3ffebf0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.175649 Oct 03 15:59:56.500368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 57/107] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:56 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:59:56.504883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:56.505491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:56.512100 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.512794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.513233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.513918 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.514373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.514976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.646475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:56.654266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-809730b6-d338-4e66-b323-e2b74b185924 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1548 microversion: 2.1 time: 0.152878 Oct 03 15:59:56.654815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 58/108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:56 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:56.677076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:56.677555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:56.683482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.683964 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.684428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.685151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:56.685636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:56.686058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:56.803218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49daa6cc-eff8-4f18-83f0-4e8c5809065e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129729 Oct 03 15:59:56.803836 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 59/109] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 15:59:56 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:57.153225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:57.154597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:57.162334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:57.163016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:57.163411 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:57.164310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:57.164774 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:57.165302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:57.295644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:57.304067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4039ad3f-881a-4d26-9df4-1d688e7a6fd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.154757 Oct 03 15:59:57.304699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 60/110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:57 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:57.524703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:57.525420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:57.532275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:57.532863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:57.533382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:57.534078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:57.534533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:57.534947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:57.669617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:57.680333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:57.682177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:57.683434 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a897c86-ff2b-4a1b-a57d-47011edf1529 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.162773 Oct 03 15:59:57.684159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 61/111] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:57 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:59:58.159984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a24b8d-f733-4d00-8cbd-5f211f9ef68e", "tag": "d710284d-cf34-4ba0-b620-3fcbf1bcd02b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:58.169809 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:58.170309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:58.170772 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:58.183438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] Creating event network-changed:d710284d-cf34-4ba0-b620-3fcbf1bcd02b for instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e on hv-cinder-84456 Oct 03 15:59:58.188558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d0a0d1d6-f0c3-4e95-8017-d76dd542deb8 req-ed425a41-7acf-4dc1-9b22-3b7c48c7a6ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Oct 03 15:59:58.189182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 62/112] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:58.328165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:58.328886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:58.334960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:58.335425 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:58.335844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:58.336514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:58.336975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:58.337387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:58.470026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:58.477770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0916f51-99f7-4a14-bc7b-fe679a9cd3f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.154491 Oct 03 15:59:58.478334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 63/113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:58 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:58.709028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:58.709554 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:58.715488 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:58.715962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:58.716393 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:58.717107 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:58.717558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:58.718248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:59.006425 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:59.016769 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:59.018866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:59.020764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a35e52bd-dfdf-46d3-8f3b-4f4d2f8dda1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.315234 Oct 03 15:59:59.021833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 64/114] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 15:59:58 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:59:59.051010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2d86944-9ffc-4b77-a324-048c29de5cc8 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "POST /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.737145 Oct 03 15:59:59.052552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 51/115] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 15:59:56 2022] POST /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597/os-volume_attachments => generated 194 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:59.500205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:59.501728 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:59.514222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:59.515855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:59.517731 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:59.519853 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:59.520319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:59.522960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:59.697900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:59.705739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3d2f601-052c-47f5-a0a8-84dfa6323775 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.209974 Oct 03 15:59:59.706395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 65/116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:59 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:00.054992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:00.056041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:00.064156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:00.064645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:00.065237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:00.066572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:00.067024 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:00.067615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:00.232609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:00.242934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:00.244292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:00.245800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fecaebe-5ad2-41f6-9e8f-59ea43faa55f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.197828 Oct 03 16:00:00.246348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 52/117] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:00 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:00.728565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:00.729207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:00.736116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:00.736593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:00.737062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:00.737750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:00.738204 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:00.738630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:00.870474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:00.878191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1c02fde-7d42-4a42-95a3-e48824aa739a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.153531 Oct 03 16:00:00.879227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 66/118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:00 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:01.274253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:01.275215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:01.287321 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:01.288114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:01.288707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:01.290463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:01.291545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:01.292384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:01.485408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:01.495137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:01.496574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:01.497693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50eef1a0-ebc7-4865-baee-82cd41afa0f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.229601 Oct 03 16:00:01.513460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 53/119] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:01 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:01.692128 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "name": "network-vif-plugged", "status": "completed", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:01.703647 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:01.704155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:01.704587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:01.718637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] Creating event network-vif-plugged:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:00:01.724230 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-175a6736-f071-4d5c-93bc-f0fdf6188ea0 req-141d8e8e-b77e-493a-814b-320824691bf5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039589 Oct 03 16:00:01.725049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 67/120] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:01.903688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:01.904362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:01.911495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:01.912030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:01.912749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:01.913541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:01.914068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:01.914827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:02.056951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:02.067384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a935526-1411-4505-bc48-0adce66be095 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.167945 Oct 03 16:00:02.068330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 54/121] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:01 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:02.526344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:02.527605 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:02.535093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:02.535739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:02.536333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:02.537345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:02.537950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:02.538550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:02.758820 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:02.769642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:02.771622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:02.772741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7132ed39-8b84-4e62-8756-18fcc8f9d23e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.250659 Oct 03 16:00:02.773573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 68/122] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:02 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:03.091686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:03.093615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:03.101313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:03.102065 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:03.102697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:03.103617 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:03.104284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:03.104979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:03.110313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:03.262764 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:03.275078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c82d1f4-905b-4e97-940a-6d28b7f8ef02 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.186815 Oct 03 16:00:03.285379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 55/123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:03 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:03.799363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:03.800131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:03.808974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:03.809562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:03.810011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:03.810716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:03.811925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:03.812264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:04.002583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:04.018426 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:04.024395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:04.025645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-580543cd-17cb-49bf-8a84-1681e23ab871 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.231824 Oct 03 16:00:04.060292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 69/124] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:03 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:04.301573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:04.302876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:04.310427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:04.310857 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:04.312025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:04.312966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:04.313412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:04.314004 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:04.469993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:04.487956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-08b344bf-d83b-4d40-915c-e1c1fa9d1be3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.193121 Oct 03 16:00:04.488978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 56/125] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:04 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:05.056606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:05.057624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:05.066989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:05.067684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:05.068416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:05.069260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:05.069929 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:05.070702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:05.360163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:05.369407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:05.372744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:05.374614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc447a47-d0cc-479d-8651-511c46cbb68b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.322359 Oct 03 16:00:05.376389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 70/126] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:05 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:05.517171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:05.518417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:05.525498 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:05.526221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:05.527342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:05.528258 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:05.528902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:05.529482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:05.928415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:05.944192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33185794-77c7-49a5-82ef-2ab67d3bc5a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.429674 Oct 03 16:00:05.944819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 57/127] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:05 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:06.407970 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:06.408774 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:06.417640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:06.418470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:06.419091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:06.420164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:06.420690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5788363a-33d3-4304-a1eb-ff548eff183c", "name": "network-vif-plugged", "status": "completed", "tag": "49490488-b358-414a-b2e8-87117b319960"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:06.421338 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:06.422048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:06.436264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:06.437094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:06.438313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:06.457410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] Creating event network-vif-plugged:49490488-b358-414a-b2e8-87117b319960 for instance 5788363a-33d3-4304-a1eb-ff548eff183c on hv-cinder-84456 Oct 03 16:00:06.466429 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-34da03ae-bd26-4584-a8f0-af948c09e57a req-254bbbd8-db35-4db1-80c9-8ecc83757c8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048889 Oct 03 16:00:06.468428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 58/128] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:00:06.691517 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:06.712015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:06.714582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:06.719595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb80e392-da4d-480e-81e6-eb0fac5b6edc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.321283 Oct 03 16:00:06.735906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 71/129] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:06 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:06.975253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:06.976976 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:06.986029 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:06.988140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:06.988668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:06.989514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:06.994007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:07.002717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:07.210260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:07.219816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4843eed3-9b20-4a33-a962-65ab938112d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.251963 Oct 03 16:00:07.220318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 59/130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:06 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:07.360137 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1641045973", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "networks": [{"uuid": "c3ebf8a3-15ef-4ba4-87bc-962a0f991337"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:07.438960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] validate_networks() for [('c3ebf8a3-15ef-4ba4-87bc-962a0f991337', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:00:07.750456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:07.751449 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:07.757875 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:07.758708 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:07.759409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:07.760746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:07.761448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:07.762083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:08.094463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:08.103275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:08.109144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:08.111900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9563b7dc-d754-4174-be48-e6100d28e33b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1408 microversion: 2.20 time: 0.365445 Oct 03 16:00:08.117914 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 60/131] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:07 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:08.234327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:00:08.235033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:00:08.235662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:00:08.236225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:00:08.236840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:00:08.243414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:08.244284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:08.257186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:08.257935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:08.258547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:08.259633 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:08.260175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:08.260434 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:08.260677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:08.261210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:08.261507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:08.263853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:08.265709 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:08.266164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:08.289598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Getting quotas for project 1616ab7beef7499280c47114208878fe. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:00:08.297472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Getting quotas for user eeb6f39c8c2b4a2f9ae77a20a20b655c and project 1616ab7beef7499280c47114208878fe. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:00:08.332017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:00:08.334886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:00:08.459563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2b8ad21-920c-4d97-a2f0-824fa99f76e7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103884 Oct 03 16:00:08.461447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 72/132] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 16:00:08.493803 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-745504ea-354c-45e8-8fdd-3839e5ef4b04 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:08.494565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-745504ea-354c-45e8-8fdd-3839e5ef4b04 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:08.601122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-745504ea-354c-45e8-8fdd-3839e5ef4b04 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:08.614710 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-745504ea-354c-45e8-8fdd-3839e5ef4b04 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1214 microversion: 2.1 time: 0.143147 Oct 03 16:00:08.618064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 73/133] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:08 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:08.647399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:08.659089 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1d6cd51-f632-4e45-94cc-a91484bc78c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.419388 Oct 03 16:00:08.661456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 61/134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:08 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:09.145163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:09.145780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:09.153614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.154208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.158767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.174254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.175036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.175544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.369597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:09.385103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:09.386582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:09.388691 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccab259f-053e-479a-aedf-fe78cf36a129 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1599 microversion: 2.20 time: 0.247377 Oct 03 16:00:09.390186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 74/135] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:00:09 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1599 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:00:09.418228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:09.419436 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:09.423867 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=80 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:09.428143 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.429021 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.429642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.430581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.431241 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.431851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.518776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebe75c0f-32bb-49d7-a39c-be033be29465 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107487 Oct 03 16:00:09.519538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 62/136] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Oct 3 16:00:09 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 16:00:09.638066 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:09.638682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:09.650555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.651289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.652069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.654119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.655349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.658083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.688873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:09.689705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:09.698529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.701103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.701742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.703192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:09.707482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:09.708261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:09.818673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:09.821309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:09.840467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55fc0f1e-9398-4b6c-9fd1-43e2586059b5 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1218 microversion: 2.1 time: 0.201689 Oct 03 16:00:09.844091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 75/137] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:09 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:10.226871 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:10.261628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68fe1318-0b14-41e7-a7d4-b0f38f619596 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.578030 Oct 03 16:00:10.263853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 63/138] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:09 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:10.304971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:10.305723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:10.322294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.322619 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.323054 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:10.324050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.324398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.324857 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:10.382629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:00:10.547593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-adca52c4-4ca6-406a-883f-0635711f5ace tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 204 len: 0 microversion: 2.1 time: 0.246202 Oct 03 16:00:10.550634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 76/139] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:00:10 2022] DELETE /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:00:10.565886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:10.568579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:10.589888 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.593957 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.595551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:10.596302 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.603452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.604106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:10.871242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:10.872576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:10.875949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:10.882018 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.882732 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.883334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:10.884189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:10.884848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:10.885423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:11.049106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:11.060238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c7a473f-59c4-496b-a81f-51b0ecfe41ea tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1554 microversion: 2.1 time: 0.505047 Oct 03 16:00:11.062435 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 64/140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:10 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1554 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:11.287672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:11.288572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:11.295196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:11.296360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:11.297000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:11.297702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:11.298153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:11.298573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:11.397547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:11.413194 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1600ecf1-f1bd-4824-b3c2-0539e40ced8c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1210 microversion: 2.1 time: 0.549335 Oct 03 16:00:11.414087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 77/141] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:10 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1210 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:11.636474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:11.647347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54fa952e-adf7-4fb5-923b-0de9bf2af464 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1322 microversion: 2.1 time: 0.363583 Oct 03 16:00:11.647921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 65/142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:11 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:12.083499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:12.085962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:12.087180 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:12.102706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.103196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.104336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.110031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.110417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.111645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.112288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.116592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.117381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.163748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] Creating event network-changed:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:00:12.181438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d67fd2a8-93ef-4f18-b8ed-031ff1822c36 req-6e7f9bc4-8f3a-4528-99e1-ba2dd8fe2d5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104524 Oct 03 16:00:12.185090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 78/143] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:12.449638 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:12.453240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:12.454094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:12.465360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.466155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.466848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.476119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.476852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.477718 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.479807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40529648-3c04-4f6a-b638-1a251c28f1e1 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1554 microversion: 2.1 time: 0.399868 Oct 03 16:00:12.485189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 66/144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:12 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1554 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:12.580595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:12.590141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ed6e50f-7991-4414-907c-b615202f3c9a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1210 microversion: 2.1 time: 0.151161 Oct 03 16:00:12.590726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 79/145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:12 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:12.677548 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:12.678058 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:12.705247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.711311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.711768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:12.712496 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:12.712978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:12.713399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.069657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:13.091437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47277111-be2d-4fec-8a59-8bd2a4950585 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1515 microversion: 2.1 time: 0.423885 Oct 03 16:00:13.094589 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 67/146] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:12 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:13.127808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:13.133472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:13.151866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.153673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.155397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.160446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.161282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.163192 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.209885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'flavor' on Instance uuid 5788363a-33d3-4304-a1eb-ff548eff183c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:00:13.455156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e649536-7981-4594-8073-04362b7c6f06 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c/action" status: 200 len: 32 microversion: 2.1 time: 0.330092 Oct 03 16:00:13.456132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 80/147] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:00:13 2022] POST /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c/action => generated 32 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:00:13.472253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:13.473530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:13.480585 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.481512 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.482278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.484459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.485870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.486556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.508909 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:13.510590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:13.525547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.528594 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.529725 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.529971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.538115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.538645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.925093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:13.937609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb86ee86-51c1-4dec-a869-e96483792a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.472415 Oct 03 16:00:13.938406 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 68/148] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:13 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:13.953537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:13.954513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:13.971942 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.980595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.981836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:13.984599 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:13.987809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:13.989011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:13.990866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:14.009694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4169724d-c33c-4c95-9212-f53fcf85b368 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1554 microversion: 2.1 time: 0.498521 Oct 03 16:00:14.011575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 81/149] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:13 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1554 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:14.300785 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:14.327623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65548b4f-3730-4ded-881b-900e061939d4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1210 microversion: 2.1 time: 0.385415 Oct 03 16:00:14.328630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 69/150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:13 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1210 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:14.965762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:14.966375 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:14.977498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:14.980030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:14.990975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:14.994315 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:14.999684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:15.000542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:15.036109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:15.036709 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:15.047468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:15.049304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:15.050438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:15.052036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:15.053796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:15.054405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:15.599845 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:15.619669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f54806d3-43f7-4d0a-8e56-d53858bceaa7 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1554 microversion: 2.1 time: 0.587458 Oct 03 16:00:15.622376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 70/151] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:15 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1554 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:15.628522 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:15.629163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:15.654451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:15.655129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:15.662579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:15.665648 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:15.667649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:15.669386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:16.225835 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:16.250707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85e1e381-c213-450f-8014-d12d9ac2d752 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1272 microversion: 2.1 time: 0.624526 Oct 03 16:00:16.251594 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 71/152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:15 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1272 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:16.263490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597", "name": "network-vif-deleted", "tag": "d98370fa-9fb9-4a61-b4bb-53554447eae1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:16.282842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:16.283493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:16.284175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:16.317803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] Creating event network-vif-deleted:d98370fa-9fb9-4a61-b4bb-53554447eae1 for instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 on hv-cinder-84456 Oct 03 16:00:16.325905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-71c664b5-f1b8-4404-9d21-8d1de89bded0 req-7f6b2610-07af-4075-8dee-8c8de08f2496 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072565 Oct 03 16:00:16.329087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 72/153] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:16.545214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:16.582057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf57a3fc-6100-4070-80a0-b63625c301f8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 1.620391 Oct 03 16:00:16.584276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 82/154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:14 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:16.652647 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:16.654038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:16.668546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:16.671034 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:16.671802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:16.673008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:16.677334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:16.678744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:16.740626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:16.794950 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:16.795979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:16.796423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:16.797049 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lazy-loading 'fault' on Instance uuid cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:00:16.942461 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105c6710d8994b0c9a1b66c4dad6dbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943f7e5ccad5410896a40678aeaaf1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:16.963753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1aa79597-df3a-442b-9874-f07445183f07 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 200 len: 1350 microversion: 2.1 time: 0.315873 Oct 03 16:00:16.965542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 73/155] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:16 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 1350 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:17.279049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:17.280676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:17.293431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:17.294104 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:17.294752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:17.295681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:17.296483 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:17.297029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:17.498595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:17.511022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99a57405-1a73-4640-92e0-6da1e8b82d92 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1272 microversion: 2.1 time: 0.235879 Oct 03 16:00:17.512537 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 83/156] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:17 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:17.612994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:17.613657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:17.624958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:17.628276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:17.628943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:17.630996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:17.631643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:17.634800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:17.989208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:17.990450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:17.999435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.000499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.001077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:18.002265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.002849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.003604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:18.022652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] HTTP exception thrown: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Request method failure captured: Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 HTTP/1.1 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbNmSaVhStSfTOR17Eg4rkEYc16f7uJRZQE1m6iSBbo5aEpCCUruu68pqI6TRyMwqQ7SURz224YgbRmVw7mnvoQo7cP8yezbP907-5L22JSFzoJ6-WbuDjHIlPdimKFWjlj-btD-28ZpVGM6i0qUrf29pF1YFzUv9P-oqRhSu9fhRw Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:00:18.027402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_943f7e5ccad5410896a40678aeaaf1c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 105c6710d8994b0c9a1b66c4dad6dbc8 Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.028917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597'} Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:18.029802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.031167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.033274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Returning 404 to user: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:18.034445 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06fd4632-9369-417c-8100-21fd3334a355 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 404 len: 111 microversion: 2.1 time: 0.050662 Oct 03 16:00:18.039620 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 84/157] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:17 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:00:18.166284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:18.167890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:18.173616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:18.184086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.184700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.185266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:18.185398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf4fece0-a7e3-49d1-bdf5-53a5f24b5b91 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.577393 Oct 03 16:00:18.196981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 74/158] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:17 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:18.197181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.197181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.197181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:18.204437 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] HTTP exception thrown: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Request method failure captured: Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597/os-volume_attachments HTTP/1.1 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbNmSaVhStSfTOR17Eg4rkEYc16f7uJRZQE1m6iSBbo5aEpCCUruu68pqI6TRyMwqQ7SURz224YgbRmVw7mnvoQo7cP8yezbP907-5L22JSFzoJ6-WbuDjHIlPdimKFWjlj-btD-28ZpVGM6i0qUrf29pF1YFzUv9P-oqRhSu9fhRw Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:00:18.206402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_943f7e5ccad5410896a40678aeaaf1c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 105c6710d8994b0c9a1b66c4dad6dbc8 Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.207881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'server_id': 'cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597'} Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:18.208682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:18.210010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:00:18.211781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Returning 404 to user: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:18.212771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-135211b9-c8d1-4cd1-8453-13e2a39336f5 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050963 Oct 03 16:00:18.213786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 85/159] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:00:18 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:00:18.536603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:18.537327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:18.549140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.549717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.550393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:18.551389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:18.552196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:18.552772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.090109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:19.100663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ad9db35-460c-469f-a47e-219aadf10eca tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.568133 Oct 03 16:00:19.101428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 75/160] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:18 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:19.215746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:19.216703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:19.235303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:19.237021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:19.240895 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.242833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.243420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.244786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.246292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.247014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.469115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:19.469859 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:19.487736 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.488587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.489016 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.489725 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.490176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.490595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.534521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] HTTP exception thrown: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Request method failure captured: Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 HTTP/1.1 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbNmSaVhStSfTOR17Eg4rkEYc16f7uJRZQE1m6iSBbo5aEpCCUruu68pqI6TRyMwqQ7SURz224YgbRmVw7mnvoQo7cP8yezbP907-5L22JSFzoJ6-WbuDjHIlPdimKFWjlj-btD-28ZpVGM6i0qUrf29pF1YFzUv9P-oqRhSu9fhRw Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:00:19.548955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_943f7e5ccad5410896a40678aeaaf1c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 105c6710d8994b0c9a1b66c4dad6dbc8 Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.550410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597'} Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:19.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.552469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.557727 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Returning 404 to user: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:19.558813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6d1b721-05d8-4bd6-beee-d597c260745b tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 404 len: 111 microversion: 2.1 time: 0.094760 Oct 03 16:00:19.565594 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 76/161] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:00:19 2022] DELETE /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:00:19.576838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:19.589867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-471a0565-05a9-4724-8339-b32f67e99308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.382194 Oct 03 16:00:19.590505 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 86/162] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:19 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:19.607848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:19.608978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] [instance: cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:19.636489 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.642183 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.645369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.650103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.651816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.652159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93275a67-788f-4fed-846f-eefe6ee3b480", "tag": "c24966bd-e271-4636-b326-52857f68318d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:19.653360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.673474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] HTTP exception thrown: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Request method failure captured: Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 HTTP/1.1 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbNmSaVhStSfTOR17Eg4rkEYc16f7uJRZQE1m6iSBbo5aEpCCUruu68pqI6TRyMwqQ7SURz224YgbRmVw7mnvoQo7cP8yezbP907-5L22JSFzoJ6-WbuDjHIlPdimKFWjlj-btD-28ZpVGM6i0qUrf29pF1YFzUv9P-oqRhSu9fhRw Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:00:19.676107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_943f7e5ccad5410896a40678aeaaf1c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/943f7e5ccad5410896a40678aeaaf1c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 943f7e5ccad5410896a40678aeaaf1c1 Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-2037017143 Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 105c6710d8994b0c9a1b66c4dad6dbc8 Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-2037017143-project Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.677386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597'} Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:19.678009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. Oct 03 16:00:19.679155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:19.680875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:19.681945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] Returning 404 to user: Instance cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:19.682906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c9cfe09-66b7-4bfc-a030-f62d46ea90c0 tempest-DeleteServersTestJSON-2037017143 tempest-DeleteServersTestJSON-2037017143-project] 10.222.0.33 "GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597" status: 404 len: 111 microversion: 2.1 time: 0.112244 Oct 03 16:00:19.683895 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 77/163] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:19 2022] GET /compute/v2.1/servers/cbbd2b91-5cfc-4ef6-b70d-5fd7ef339597 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:00:19.684650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:19.685119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:19.711249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] Creating event network-changed:c24966bd-e271-4636-b326-52857f68318d for instance 93275a67-788f-4fed-846f-eefe6ee3b480 on hv-cinder-84456 Oct 03 16:00:19.728663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a3badc8e-d015-4eae-abb2-bb47c54790a8 req-6e0a3c00-582b-440d-b955-b3a29f65d72d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080644 Oct 03 16:00:19.729957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 87/164] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:00:20.125276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:20.126081 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:20.137914 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:20.138510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:20.141227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:20.142511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:20.144830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:20.145528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:20.376006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:20.384993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b18305a4-f979-4527-a944-d4068bd54089 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.264588 Oct 03 16:00:20.400300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 78/165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:20 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:20.618514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:20.619868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:20.626737 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:20.627470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:20.628146 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:20.629122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:20.629793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:20.630456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:20.820000 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:20.831311 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8055ada2-6493-44d6-8309-7bc0444a27ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.216530 Oct 03 16:00:20.831910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 88/166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:20 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:21.411886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:21.412269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:21.420913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:21.421602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:21.422182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:21.423113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:21.431907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:21.432810 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:21.759160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:21.768638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51548d27-c18e-4634-943d-e0c447b17f5f tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.364379 Oct 03 16:00:21.779127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 79/167] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:21 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:21.855578 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:21.857087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:21.864820 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:21.866007 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:21.866708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:21.867867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:21.868604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:21.869298 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:22.211193 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:22.237558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5f40538-80b4-4272-890c-6a56cbc37050 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.381812 Oct 03 16:00:22.256838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 89/168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:21 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:22.805078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:22.806585 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:22.827080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:22.827994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:22.828642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:22.834770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:22.835702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:22.837010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:23.089536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:23.101989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bac3b85-6632-445b-ac50-f292c8ae9e8a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.302537 Oct 03 16:00:23.102989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 80/169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:22 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:23.264835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:23.265912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:23.276912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:23.277507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:23.278833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:23.283152 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:23.286704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:23.287389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:23.645118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:23.657258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56aeecb2-e664-46ba-82e9-9b23c50d582e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.397657 Oct 03 16:00:23.670221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 90/170] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:23 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:24.046870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5bcc9ac1-2f13-414f-b6cb-cd81189062c1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Action: 'create', calling method: .version_select at 0x7f8174ed9e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-2036203080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuzPTsqK2+vP6b51TXJ5m9uDt+U0SYR66A0fyzjV+M6FF/G953gQTu1ws2Aw0/Tp5rK8ByE31m7r5gosB9oJ6Wzm+EoLESLDLiJEV6D6I1EW1xdqPZa8EXZcjiwtXOZew=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:24.081259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-5bcc9ac1-2f13-414f-b6cb-cd81189062c1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Getting quotas for project 60b016d4443142d4bb81dae536748cf1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:00:24.098513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-5bcc9ac1-2f13-414f-b6cb-cd81189062c1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Getting quotas for user 950e06d7bfff4259972ae1312e8f913a and project 60b016d4443142d4bb81dae536748cf1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:00:24.130231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:24.131177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:24.140874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:24.143501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:24.144252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:24.146198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5bcc9ac1-2f13-414f-b6cb-cd81189062c1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.588550 Oct 03 16:00:24.146781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:24.148846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:24.149441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 81/171] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:00:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:00:24.150449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:24.230499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:24.519164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93275a67-788f-4fed-846f-eefe6ee3b480", "name": "network-vif-plugged", "status": "completed", "tag": "c24966bd-e271-4636-b326-52857f68318d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:24.539911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:24.542034 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:24.542869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:24.575101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] Creating event network-vif-plugged:c24966bd-e271-4636-b326-52857f68318d for instance 93275a67-788f-4fed-846f-eefe6ee3b480 on hv-cinder-84456 Oct 03 16:00:24.583512 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-aaa44bee-e25c-4238-a6ab-04ac282011e3 req-d1471b0f-2b65-4ea3-b9c1-8b0c56dd4300 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068308 Oct 03 16:00:24.587559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 82/172] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:24.684329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:24.685148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:24.700660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:24.701756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:24.702211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:24.707906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:24.708408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:24.712338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:24.718684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:24.739106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c0aaf83-adca-4990-8f75-973eaa171fe0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.612743 Oct 03 16:00:24.755988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 91/173] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:24 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:25.574431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:25.586870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d96ed4b3-320b-4957-9f04-b5fb4b32ea11 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.907393 Oct 03 16:00:25.588437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 83/174] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:24 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:25.766623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:25.767837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:25.776045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:25.780173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:25.780889 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:25.782162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:25.788461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:25.788956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:26.094284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:26.106522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d94109f-5c95-4e13-aa6a-b807f159dee0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.344275 Oct 03 16:00:26.111664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 92/175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:25 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:26.612579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:26.613216 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:26.629277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:26.629955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:26.630733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:26.631745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:26.632415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:26.633130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:26.881413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:26.892520 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c21f92e-dacc-49e7-9fae-f2a0e63de3dd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.284262 Oct 03 16:00:26.894870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 84/176] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:26 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:27.135181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:27.136362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:27.145478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:27.146076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:27.146618 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:27.147382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:27.147894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:27.148378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:27.335770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:27.346662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9e848de-c1a5-4768-89c5-28dcc78ee3d9 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1314 microversion: 2.1 time: 0.215764 Oct 03 16:00:27.348170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 93/177] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:27 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:27.922099 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:27.922695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:27.929773 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:27.930282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:27.930721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:27.931414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:27.931897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:27.932352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:28.079012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:28.087273 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0add148-3b90-45c8-b3d8-08a592afb985 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.169301 Oct 03 16:00:28.087854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 85/178] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:27 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:28.373785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:28.374434 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:28.380829 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:28.381317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:28.381755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:28.382462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:28.382943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:28.383371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:28.548883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:28.565577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1fef4a07-10df-4793-8e93-586eb7f3d130 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1498 microversion: 2.1 time: 0.196616 Oct 03 16:00:28.581184 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 94/179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:28 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:29.112678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:29.113355 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:29.119336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:29.121296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:29.132278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.133024 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.133420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.133850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.134556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.135005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.135448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.144377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.145454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.153538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.154880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.155375 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.206052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:00:29.332838 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-534344cc-5591-49cc-9019-f07766a67205 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 204 len: 0 microversion: 2.1 time: 0.229011 Oct 03 16:00:29.333578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 86/180] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:00:29 2022] DELETE /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:00:29.343478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:29.344171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:29.351694 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.352170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.352597 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.354138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:29.354593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:29.355504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:29.355850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:29.366389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36afb124-1909-47b3-87d0-abe15cb48e4d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.258687 Oct 03 16:00:29.366957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 95/181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:29 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:29.508166 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:29.516884 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6da9252-f3e5-4a26-998c-c54ea8b9b5dd tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1504 microversion: 2.1 time: 0.178337 Oct 03 16:00:29.517456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 87/182] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:29 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:30.392132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:30.392846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:30.401715 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:30.402248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:30.402707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:30.403380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:30.403976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:30.404889 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:30.540253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:30.540890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:30.550949 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:30.553132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:30.553765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:30.557733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:30.558403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:30.559122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:30.613776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:30.627156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-072503e2-dc8d-43e5-bbd0-dd8934a74244 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.240125 Oct 03 16:00:30.641149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 96/183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:30 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:30.783666 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:30.796269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97cd1a17-3f8d-42b0-8ae3-a72fea771dc2 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1504 microversion: 2.1 time: 0.258798 Oct 03 16:00:30.797147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 88/184] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:30 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:31.655115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:31.656303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:31.666277 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.666768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.667441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.668447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.673325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.673822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.796808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93275a67-788f-4fed-846f-eefe6ee3b480", "name": "network-vif-deleted", "tag": "c24966bd-e271-4636-b326-52857f68318d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:31.807901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.818909 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.819840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.845783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] Creating event network-vif-deleted:c24966bd-e271-4636-b326-52857f68318d for instance 93275a67-788f-4fed-846f-eefe6ee3b480 on hv-cinder-84456 Oct 03 16:00:31.852595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a706659e-e0f1-45f4-937b-8c6e8df068b7 req-6b8f9b81-7141-4dde-b155-283d83e0ed01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060861 Oct 03 16:00:31.853745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 89/185] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:00:31.862051 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:31.863067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:31.883175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.886461 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.887025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.891041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.893082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.893630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.961890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:31.973958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:31.974086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ebb6efe-3e3d-42cd-b0c3-af0ec932a6cb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.323989 Oct 03 16:00:31.974956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:31.975417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:31.976097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lazy-loading 'fault' on Instance uuid 93275a67-788f-4fed-846f-eefe6ee3b480 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:00:31.985225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 97/186] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:31 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:32.074650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:32.086162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8412c10a-a520-468e-9c10-4dd15bd72dbb tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1304 microversion: 2.1 time: 0.230245 Oct 03 16:00:32.104777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 90/187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:31 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:33.000547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:33.001445 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:33.009999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:33.011276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:33.012420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:33.013851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:33.014513 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:33.015136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:33.116186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:33.116961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:33.124395 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:33.124910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:33.126271 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:33.127593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:33.128384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:33.128987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:33.175831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:33.178281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:33.188878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c1a7ebd-7da4-499c-b20d-6ce9939ff28c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.194162 Oct 03 16:00:33.190228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 98/188] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:32 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:33.217946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:33.218756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:33.219393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:33.219902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lazy-loading 'fault' on Instance uuid 93275a67-788f-4fed-846f-eefe6ee3b480 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:00:33.262885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:33.272394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0484ed72-15de-494f-b039-406c1263372b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1304 microversion: 2.1 time: 0.160818 Oct 03 16:00:33.273353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 91/189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:33 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:34.215282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:34.215892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:34.223911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:34.224410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:34.225026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:34.225736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:34.226630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:34.227951 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:34.301939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:34.302577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:34.311780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:34.314914 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:34.318086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:34.318742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:34.323790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:34.324290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:34.324800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:34.381891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:34.382708 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:34.383357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:34.384335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lazy-loading 'fault' on Instance uuid 93275a67-788f-4fed-846f-eefe6ee3b480 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:00:34.418105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:34.440678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32ce4f15-55a0-4049-ad20-3a754f921a3e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.219224 Oct 03 16:00:34.453908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 99/190] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:34 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:34.469101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:34.479647 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8ebe62c-9185-4541-875c-45d0dac9e8e4 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 200 len: 1304 microversion: 2.1 time: 0.187295 Oct 03 16:00:34.480779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 92/191] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:34 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:35.463383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:35.465172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:35.472401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:35.473038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:35.473807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:35.474681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:35.475316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:35.476011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:35.504313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:35.505300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 93275a67-788f-4fed-846f-eefe6ee3b480] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:35.511640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:35.512307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:35.512939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:35.513963 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:35.514660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:35.515375 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:35.531257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] HTTP exception thrown: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Request method failure captured: Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 HTTP/1.1 Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwcFSPHu04kYYjPqBN2QCmMp6WQmwpFTSFCY2egfgdZAJGgr2S88DPNk3G2KMOCFgqcCJjU6hs3VDM6GazzLy4TdmQANguGV8l1hQ_sWrNE7x87dmEnGI6837oln8X_ol6kXsvHbmNhqiqB15GT0MvV9kfY9jvtwivPcH6xvHWL7bFc Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1616ab7beef7499280c47114208878fe Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesActionsTest-59262827 Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:00:35.533067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1616ab7beef7499280c47114208878fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1616ab7beef7499280c47114208878fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1616ab7beef7499280c47114208878fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1616ab7beef7499280c47114208878fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesActionsTest-59262827 Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1616ab7beef7499280c47114208878fe Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesActionsTest-59262827 Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesActionsTest-59262827-project Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: eeb6f39c8c2b4a2f9ae77a20a20b655c Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesActionsTest-59262827-project Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. Oct 03 16:00:35.534701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '93275a67-788f-4fed-846f-eefe6ee3b480'} Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:35.535392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. Oct 03 16:00:35.536469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:00:35.538540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Returning 404 to user: Instance 93275a67-788f-4fed-846f-eefe6ee3b480 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:35.542252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c0ed4c5-c12c-41d2-bbb0-19c0c1d99914 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480" status: 404 len: 111 microversion: 2.1 time: 0.039284 Oct 03 16:00:35.543439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 93/192] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:35 2022] GET /compute/v2.1/servers/93275a67-788f-4fed-846f-eefe6ee3b480 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:00:35.647733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:35.656444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-708fa4f1-9393-4344-86f6-eaeb6d99d148 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.196841 Oct 03 16:00:35.657543 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 100/193] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:35 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:35.670066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1778883109", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "networks": [{"uuid": "c3ebf8a3-15ef-4ba4-87bc-962a0f991337"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:35.724955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] validate_networks() for [('c3ebf8a3-15ef-4ba4-87bc-962a0f991337', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:00:36.100358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:00:36.100813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:00:36.101310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:00:36.101718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:00:36.102127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:00:36.111281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:36.111703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:36.112133 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:36.112876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:36.113488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:36.114091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:36.143334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Getting quotas for project 1616ab7beef7499280c47114208878fe. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:00:36.147547 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Getting quotas for user eeb6f39c8c2b4a2f9ae77a20a20b655c and project 1616ab7beef7499280c47114208878fe. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:00:36.165362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:00:36.168412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:00:36.188897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:36.240129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8daa538-4105-4193-953f-f0b01165ca03 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574310 Oct 03 16:00:36.246747 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 94/194] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 16:00:36.253643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed9a482e-4219-4a9a-9cf1-78845ffb546d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:36.254165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed9a482e-4219-4a9a-9cf1-78845ffb546d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:36.405280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed9a482e-4219-4a9a-9cf1-78845ffb546d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:36.426316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed9a482e-4219-4a9a-9cf1-78845ffb546d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1214 microversion: 2.1 time: 0.177428 Oct 03 16:00:36.427316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 101/195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:36 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:36.682582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:36.683313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:36.691511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:36.691991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:36.692732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:36.693688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:36.694174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:36.694844 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:36.867124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:36.875011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33a81d82-53de-4bef-9030-60835aab5a84 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.197332 Oct 03 16:00:36.875576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 95/196] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:36 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:37.448591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:37.449237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:37.455955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:37.456442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:37.456906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:37.457596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:37.458053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:37.458473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:37.524669 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:37.532250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7279c176-89a6-4834-b16e-6c574468e488 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1266 microversion: 2.1 time: 0.087460 Oct 03 16:00:37.532831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 102/197] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:37 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:37.902811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:37.903967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:37.913663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:37.914144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:37.914586 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:37.915298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:37.915771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:37.916158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:38.190138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:38.198779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bea9ae95-4732-4cca-8818-b33487e9df80 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.304549 Oct 03 16:00:38.199467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 96/198] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:37 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:38.555493 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:38.556395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:38.563367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:38.563969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:38.564507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:38.565450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:38.566006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:38.566641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:38.809491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:38.819203 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95a6b330-e4c6-494e-9108-4e81c6f13a45 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.268064 Oct 03 16:00:38.820008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 103/199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:38 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:39.227556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:39.228594 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:39.250002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:39.250608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:39.251646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:39.252872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:39.253772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:39.254415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:39.792578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:39.802447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52c4a9bd-beeb-403e-8391-2fbac76ac18f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.582554 Oct 03 16:00:39.802945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 97/200] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:39 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:39.844561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:39.845204 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:39.851692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:39.852489 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:39.853157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:39.854059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:39.854706 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:39.855326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:39.858058 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01720cfb-59ec-47a5-b8e9-30204c4d4e58", "tag": "ba8f633c-1c11-4174-bcae-8ed9ee5701e8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:39.870455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:39.870928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:39.871348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:39.883828 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] Creating event network-changed:ba8f633c-1c11-4174-bcae-8ed9ee5701e8 for instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 on hv-cinder-84456 Oct 03 16:00:39.894617 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2f917f54-7f36-4f17-a399-3c9eb865b4d9 req-3f6e022e-e951-4929-99d9-83b12d0e90c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042110 Oct 03 16:00:39.895481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 98/201] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:40.146988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:40.155102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35006546-fc2c-4b5a-8236-d7af292d5e4d tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.315442 Oct 03 16:00:40.156234 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 104/202] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:39 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:40.828366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:40.829678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:40.837025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:40.837586 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:40.838209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:40.839097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:40.840276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:40.841750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:40.977411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:40.985901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18237eec-8be8-42dc-b9e9-3ee111b081f6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.164287 Oct 03 16:00:40.986462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 99/203] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:40 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:41.178667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:41.179329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:41.181214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=58 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:41.187566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:41.188011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:41.188471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:41.189368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:41.189821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:41.190241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:41.334827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:41.343197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8510021d-7caa-4d31-bec6-0661b4eefc9b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.168337 Oct 03 16:00:41.343772 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 105/204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:41 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:42.009259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:42.010417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:42.023087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:42.030076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:42.030856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:42.032486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:42.033100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:42.033624 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:42.308745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:42.331255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d896e582-e1d7-4b51-a80d-8d73eeeba0d0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.326611 Oct 03 16:00:42.349821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 100/205] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:42 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:42.377373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:42.378579 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:42.388750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:42.390094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:42.390745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:42.391625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:42.399585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:42.400570 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:42.630258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:42.647289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f3b928a-fafe-400b-a4f5-b135c046dcf7 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.274493 Oct 03 16:00:42.652478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 106/206] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:42 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:43.364106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:43.365148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:43.373737 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.374301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.374802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.375566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.376191 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.376669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.547400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:43.555399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-181566b7-f3b6-4e11-8941-53839e807e56 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.202937 Oct 03 16:00:43.556248 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 101/207] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:43 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:43.679179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:43.679865 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:43.686309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.686862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.687481 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.688180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.688632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.689162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.848216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:43.858404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39378d34-e46d-4932-888f-f4e5bb7f73bc tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.183312 Oct 03 16:00:43.859249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 107/208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:43 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:44.181022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01720cfb-59ec-47a5-b8e9-30204c4d4e58", "name": "network-vif-plugged", "status": "completed", "tag": "ba8f633c-1c11-4174-bcae-8ed9ee5701e8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:44.191964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.192553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.193061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.205213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] Creating event network-vif-plugged:ba8f633c-1c11-4174-bcae-8ed9ee5701e8 for instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 on hv-cinder-84456 Oct 03 16:00:44.211842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f9a1a71b-2d78-4f20-96ca-3d1ea6f88d5d req-9bdeea59-e424-456d-b824-ff37117632a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034978 Oct 03 16:00:44.212644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 102/209] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:44.581140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:44.581758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:44.589817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.590294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.590961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.591807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.592875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.593519 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.749404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:44.757296 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1e368b5-4a4d-412b-b12f-c5423cd5d891 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.181352 Oct 03 16:00:44.757862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 108/210] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:44 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:44.886841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:44.888249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:44.895227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.895717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.896170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.896877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.897325 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.897994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.052373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:45.061172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d0cc5e8-ef24-4cd1-9f2d-17a7da31d67c tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.178799 Oct 03 16:00:45.076864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 103/211] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:44 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:45.780927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:45.782076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:45.788439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:45.788947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:45.789377 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.790076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:45.790607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:45.791058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.795890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:45.938568 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:45.946533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab3a7a70-37de-4051-bb64-18c14c01cdb9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.170137 Oct 03 16:00:45.947101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 109/212] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:45 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:46.083283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:46.083998 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:46.091212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:46.091651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:46.092387 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:46.093097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:46.093550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:46.093962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:46.126060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:46.154206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:46.247377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:46.256441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c1f459d-cdac-442d-9995-a32a471dd001 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.176961 Oct 03 16:00:46.270085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 104/213] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:46 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:46.973890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:46.975038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:46.978381 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:46.984117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:46.984908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:46.985569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:46.987896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:46.987896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:46.988306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:47.160917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:47.170179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1da340f2-dc78-4b8e-90d2-2c201fcdd7ca tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.203146 Oct 03 16:00:47.170850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 110/214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:46 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:47.282967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:47.283598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:47.291071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:47.291468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:47.291907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:47.292597 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:47.293081 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:47.293498 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:47.435421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:47.443358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f10c137c-d311-42e6-80c8-a048e298f324 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.165023 Oct 03 16:00:47.444123 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 105/215] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:47 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:48.193414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:48.194093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:48.201995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:48.202476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:48.202931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:48.203648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:48.204095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:48.204510 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:48.337937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:48.351534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3364d555-7fe1-420a-be2d-d669deeebdfa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.161942 Oct 03 16:00:48.352286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 111/216] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:48 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:48.468638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:48.469357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:48.475683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:48.476250 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:48.476771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:48.477514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:48.478118 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:48.481183 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:48.655579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:48.663354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da44b8a8-31f4-4217-bd5b-dacc80758557 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1314 microversion: 2.1 time: 0.199902 Oct 03 16:00:48.663921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 106/217] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:48 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:49.376496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:49.377657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:49.383376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:49.383859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:49.384320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:49.385271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:49.385730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:49.386154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:49.585495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:49.594097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53b43d45-5961-4a40-acf0-9816e2913d9c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.222083 Oct 03 16:00:49.598101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 112/218] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:49 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:49.687944 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:49.688697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:49.698550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:49.699645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:49.701130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:49.702114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:49.702580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:49.703197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:49.895208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:49.906006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07491b93-fc19-4f10-9efa-187f51420923 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1498 microversion: 2.1 time: 0.223053 Oct 03 16:00:49.913583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 107/219] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:49 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:50.127541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-97137109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2036203080", "security_groups": [{"name": "tempest-secgroup-smoke-316933564"}], "networks": [{"uuid": "793e8504-b1fb-440d-84d6-d2ad56065f0c"}], "block_device_mapping_v2": [{"uuid": "96bcfa0b-5229-44f2-b5f9-e857c2d9c924", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:50.297368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] validate_networks() for [('793e8504-b1fb-440d-84d6-d2ad56065f0c', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:00:50.617706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:50.627054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:50.630219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:50.630902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:50.631384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:50.632089 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:50.632534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:50.633093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:50.841053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:00:50.841053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:00:50.841053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:00:50.841053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:00:50.841053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:00:50.851481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:50.857427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:50.858442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:50.858934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:50.859806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:50.860102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03996271-813c-4d7e-85cf-8f991c3dc424 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.246124 Oct 03 16:00:50.860484 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:50.860943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:50.861241 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 108/220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:50 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:50.899951 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Getting quotas for project 60b016d4443142d4bb81dae536748cf1. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:00:50.905996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Getting quotas for user 950e06d7bfff4259972ae1312e8f913a and project 60b016d4443142d4bb81dae536748cf1. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:00:50.973962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:00:50.976214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96bcfa0b-5229-44f2-b5f9-e857c2d9c924',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:00:51.115320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-001d61ac-9e8a-47a7-8dbc-a9479a9bb259 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991936 Oct 03 16:00:51.115972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 113/221] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:00:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:00:51.127714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b18ab1a-9242-4e92-bdaa-671cd1583951 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:51.128868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b18ab1a-9242-4e92-bdaa-671cd1583951 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:51.189880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b18ab1a-9242-4e92-bdaa-671cd1583951 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:51.201917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b18ab1a-9242-4e92-bdaa-671cd1583951 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1087 microversion: 2.1 time: 0.078006 Oct 03 16:00:51.202554 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 109/222] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:51 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:51.893903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:51.894514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:51.900664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:51.901182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:51.901614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:51.902289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:51.903000 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:51.903547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:52.181456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:52.190176 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5adca876-fa60-4ea5-8f2e-a649e1bdaaeb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.300684 Oct 03 16:00:52.190754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 114/223] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:51 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:52.225840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:52.226443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:52.233825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:52.234303 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:52.234732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:52.235414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:52.235859 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:52.236272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:52.301441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:52.309763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-044e9eef-3a80-4107-a49e-6b58ddd189d7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1137 microversion: 2.1 time: 0.087724 Oct 03 16:00:52.310394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 110/224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:52 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:53.213883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:53.215034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:53.222075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.223461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.224170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.225106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.226041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.226475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.333322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:53.334587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:53.346272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.347078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.347580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.350544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.351244 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.351795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.359600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:53.432615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:53.447310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:53.447937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c89256fb-61b0-4659-b516-69a42a67f6c4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1185 microversion: 2.1 time: 0.118928 Oct 03 16:00:53.448740 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 111/225] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:53 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:53.453360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:53.454097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:53.457278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30fc5408-18f8-44bc-813f-e22866956094 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.247669 Oct 03 16:00:53.457874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 115/226] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:53 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:53.468869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.468869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.468869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.468869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.469239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.469239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.474773 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:53.475266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:53.489472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.489966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.490404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.491111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.491571 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.491993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.523134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-185e3b62-3b8d-4d1b-9b9c-ae2ab36abc0b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/ips" status: 200 len: 145 microversion: 2.1 time: 0.051991 Oct 03 16:00:53.523941 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 116/227] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:00:53 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:53.678265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:00:53.783374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da030d57-cc44-45d4-94a9-d5c631b49997 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "DELETE /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 204 len: 0 microversion: 2.1 time: 0.333581 Oct 03 16:00:53.784303 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 112/228] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:00:53 2022] DELETE /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:00:53.792536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:53.793170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:53.802419 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.802898 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.803523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.804247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:53.804945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:53.805534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:53.983321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:53.990950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff940489-82c6-41ee-afc9-766763844e84 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1504 microversion: 2.1 time: 0.202407 Oct 03 16:00:53.991608 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 117/229] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:53 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:54.475948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:54.476684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:54.483861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:54.484339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:54.484797 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:54.486055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:54.486055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:54.486338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:54.489719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:54.490324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:54.496404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:54.499644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:54.500006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:54.500879 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:54.501438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:54.502028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:54.590584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:54.602342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1abaa93a-b0f1-4c27-88b9-5ab9a68237c2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1193 microversion: 2.1 time: 0.130571 Oct 03 16:00:54.602965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 113/230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:54 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1193 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:54.666336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:54.676217 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-826e0c81-de24-46da-a290-9ab1e164f864 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.190211 Oct 03 16:00:54.677002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 118/231] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:54 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:55.022599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:55.023220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:55.031540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.032023 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.032450 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.033363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.033992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.034393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.175061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:55.183407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd83d3b6-4865-4dc1-98a3-fa73b4b4ce47 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1504 microversion: 2.1 time: 0.172610 Oct 03 16:00:55.184042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 114/232] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:55 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:55.625945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:55.626554 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:55.633449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.634007 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.634663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.635441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.636105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.636747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.699460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:55.700614 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:55.707284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.707617 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.708055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.708763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:55.709215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:55.709630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:55.727092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:55.735336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-251f9cd3-7283-415e-b520-899c69ee76a0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1193 microversion: 2.1 time: 0.113911 Oct 03 16:00:55.735921 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 119/233] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:55 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:55.870330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:55.878887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4024b53-96ef-4f21-a0ca-23f71ef32fdc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.183374 Oct 03 16:00:55.893400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 115/234] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:55 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:56.207796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:56.208318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:56.215241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.215757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.216319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:56.218004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.218481 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.219185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:56.399523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:56.409071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b8374d0-31e9-4b37-a35a-075735befec0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1504 microversion: 2.1 time: 0.205339 Oct 03 16:00:56.409650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 120/235] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:56 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:56.759426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:56.760246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:56.767591 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.768183 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.768683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:56.769472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.769994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.770478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:56.842349 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:56.853860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0650dd60-77c1-429b-b964-404b26b3f210 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1193 microversion: 2.1 time: 0.098136 Oct 03 16:00:56.855073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 116/236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:56 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:56.904301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:56.905001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:56.913984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.914435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.915079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:56.915980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:56.916600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:56.917068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:57.076890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:57.084601 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5739f8b6-768a-45c2-88f0-9a4670f1e218 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.185067 Oct 03 16:00:57.085788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 121/237] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:56 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:57.436469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:57.437312 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:57.444996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:57.445832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:57.446225 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:57.446965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:57.447410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:57.447966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:57.738273 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:57.757443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41db6e3c-be79-4814-9fe3-6bc3a031a78a tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1504 microversion: 2.1 time: 0.324407 Oct 03 16:00:57.759463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 117/238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:57 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:57.887094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:57.888124 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:57.897403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:57.898021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:57.898687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:57.899519 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:57.900412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:57.901128 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.113407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:58.114308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:58.133278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:58.134031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:58.134735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.135458 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:58.138747 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:58.141017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.264293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:58.279845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a4a9929-c2cc-4c16-a37f-1542d18c1189 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1203 microversion: 2.1 time: 0.396523 Oct 03 16:00:58.285412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 122/239] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:57 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1203 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:58.506802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:58.521663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd90dc47-965d-4a8f-8b36-5733ea9cf650 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.416611 Oct 03 16:00:58.524340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 118/240] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:58 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:58.785628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:58.786321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:58.792848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:58.794099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:58.794643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.796279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:58.797015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:58.797908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.811748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01720cfb-59ec-47a5-b8e9-30204c4d4e58", "name": "network-vif-deleted", "tag": "ba8f633c-1c11-4174-bcae-8ed9ee5701e8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:58.822506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:58.823359 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:58.823786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:58.836563 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] Creating event network-vif-deleted:ba8f633c-1c11-4174-bcae-8ed9ee5701e8 for instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 on hv-cinder-84456 Oct 03 16:00:58.842313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a5948027-4dba-4029-be52-c2f4e86e5b28 req-2f6c3322-7b73-45ad-ad8e-bd9453fe2761 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Oct 03 16:00:58.843239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 119/241] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:58.877444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:58.885471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80df49e8-b58b-4b31-b2b6-449918047690 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1462 microversion: 2.1 time: 0.103785 Oct 03 16:00:58.885964 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 123/242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:58 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:59.313388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:59.314179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:59.321090 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.321569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.321997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.322679 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.323124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.323532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.465784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:59.473887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5b51648-c1b9-4c00-b754-cf4d2ed64e31 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.165237 Oct 03 16:00:59.474450 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 120/243] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:59 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:59.545282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:59.545910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:59.550443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc2d8994-b305-4823-8500-b600ad8d304c"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:59.551875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.552358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.552822 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:59.552933 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.553521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.553979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.554417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.558725 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.559209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.559744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.560431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.560907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.561319 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.689317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:59.696978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1877f2ed-47d6-436f-a915-28594d4ab140 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.155998 Oct 03 16:00:59.697584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 124/244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:59 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:59.908932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:59.909536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:59.915401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.915866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.916292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.916985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:59.917427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:59.917854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:59.978015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:59.986248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0d22bd9-4eb3-4567-8e33-ad83e791b7a0 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1462 microversion: 2.1 time: 0.081171 Oct 03 16:00:59.986819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 125/245] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:59 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:00.498475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:00.499091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:00.505640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:00.506122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:00.506553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:00.507317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:00.507775 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:00.508197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:00.642703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:00.644930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:00.651461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d97fe816-1ff2-4034-a21c-d6680e8e7b49 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.157897 Oct 03 16:01:00.652021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 126/246] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:00 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:00.720474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:00.721113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:00.726968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:00.727441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:00.727867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:00.728539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:00.729017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:00.729432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:00.858594 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:00.866396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5cdaa93-3ff3-4a9f-9f43-2338ca898c04 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.150213 Oct 03 16:01:00.866963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 127/247] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:00 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:01.013585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:01.014189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:01.015993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:01.016643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:01.025162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.025644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.026090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:01.026778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.027225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.027730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:01.095378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:01.103623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75a4af07-061e-406b-928c-0ce9f478b38b tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1462 microversion: 2.1 time: 0.093955 Oct 03 16:01:01.104283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 128/248] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:01 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:01.194615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:01.675304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:01.675911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:01.681943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.682418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.682843 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:01.683522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.683963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.684400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:01.819198 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:01.827358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-769af3e4-47fd-44b4-9432-cbca59e11777 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.156442 Oct 03 16:01:01.827908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 129/249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:01 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:01.890661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:01.891253 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:01.897023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.897503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.897934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:01.898614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:01.899057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:01.899471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:02.036257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:02.044260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be0fd696-44ad-4e92-a7c4-f9f2a4b13183 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.157863 Oct 03 16:01:02.045013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 130/250] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:01 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:02.128322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:02.128972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:02.135208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:02.135688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:02.136118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:02.136852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:02.137297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:02.137713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:02.199287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:02.208800 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87d3cc00-d253-40dd-927c-736d9abcc779 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1462 microversion: 2.1 time: 0.084493 Oct 03 16:01:02.209376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 131/251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:02 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:02.751474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2ddf390-50f5-4f4a-b1bf-113a1fa6e1c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.204838 Oct 03 16:01:02.753631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 121/252] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:00:59 2022] POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments => generated 194 bytes in 3207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:01:02.851177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:02.852391 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:02.860268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:02.860949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:02.861522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:02.862521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:02.863277 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:02.864034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.072603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:03.073508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:03.089965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.090782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.093285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.094229 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.095703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.096680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.139912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:03.166751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ac023bb-df46-4c74-ad95-39859446b05e tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.319476 Oct 03 16:01:03.180778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 132/253] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:02 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:03.233874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:03.235004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:03.250075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.250588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.251131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.252971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.253782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.256366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.303885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.304371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.305036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.305900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lazy-loading 'fault' on Instance uuid 01720cfb-59ec-47a5-b8e9-30204c4d4e58 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:01:03.379540 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb6f39c8c2b4a2f9ae77a20a20b655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1616ab7beef7499280c47114208878fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:03.401460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78084372-b08b-48ef-9380-686c99f7a594 tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 200 len: 1304 microversion: 2.1 time: 0.162748 Oct 03 16:01:03.406665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 133/254] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:03 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:03.446012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:03.457142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eeb27a04-21e5-4fc5-a29e-61e6dd28c207 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1521 microversion: 2.1 time: 0.392681 Oct 03 16:01:03.473431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 122/255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:03 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:03.599635 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:03.627085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.627085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.627085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.638482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] Creating event network-changed:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:01:03.644653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ffbbfaf4-b2fe-4719-8069-00d47db09fc5 req-e21cf71b-a0d6-47f2-ab5c-2f63bb0734f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048628 Oct 03 16:01:03.645754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 134/256] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:04.199493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:04.200038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:04.206982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.207458 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.207884 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.208566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.209036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.209451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.420654 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:04.421561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] [instance: 01720cfb-59ec-47a5-b8e9-30204c4d4e58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:04.437696 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.454166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.454617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.455363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.455821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.456251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.478327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] HTTP exception thrown: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Request method failure captured: Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 HTTP/1.1 Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwcFSPHu04kYYjPqBN2QCmMp6WQmwpFTSFCY2egfgdZAJGgr2S88DPNk3G2KMOCFgqcCJjU6hs3VDM6GazzLy4TdmQANguGV8l1hQ_sWrNE7x87dmEnGI6837oln8X_ol6kXsvHbmNhqiqB15GT0MvV9kfY9jvtwivPcH6xvHWL7bFc Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 1616ab7beef7499280c47114208878fe Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesActionsTest-59262827 Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:01:04.480237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1616ab7beef7499280c47114208878fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1616ab7beef7499280c47114208878fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1616ab7beef7499280c47114208878fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1616ab7beef7499280c47114208878fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesActionsTest-59262827 Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 1616ab7beef7499280c47114208878fe Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesActionsTest-59262827 Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesActionsTest-59262827-project Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: eeb6f39c8c2b4a2f9ae77a20a20b655c Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesActionsTest-59262827-project Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. Oct 03 16:01:04.481713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '01720cfb-59ec-47a5-b8e9-30204c4d4e58'} Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:01:04.482841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. Oct 03 16:01:04.484032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:04.493108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] Returning 404 to user: Instance 01720cfb-59ec-47a5-b8e9-30204c4d4e58 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:01:04.493108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dbb4af0d-404a-454c-bf1e-d35085d986da tempest-VolumesActionsTest-59262827 tempest-VolumesActionsTest-59262827-project] 10.222.0.33 "GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58" status: 404 len: 111 microversion: 2.1 time: 0.066868 Oct 03 16:01:04.493108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 135/257] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:04 2022] GET /compute/v2.1/servers/01720cfb-59ec-47a5-b8e9-30204c4d4e58 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:01:04.504484 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:04.506135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:04.506765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:04.517184 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.517669 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.518459 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.519837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.520292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.521251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.527778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba902106-35d5-4602-a053-7d49f34fc63c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.330572 Oct 03 16:01:04.537511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 123/258] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:04 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:04.813362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:04.825192 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9122277-4a5a-4ff1-bc4b-413a3349d8b1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1501 microversion: 2.1 time: 0.341229 Oct 03 16:01:04.836747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 136/259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:04 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:04.852362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:04.853140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:04.863606 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.864098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.864529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:04.865254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:04.865701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:04.866117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:05.093243 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:05.116094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dae86acc-17a8-4e30-b822-42964f4e7ccf tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1514 microversion: 2.1 time: 0.268405 Oct 03 16:01:05.116670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 124/260] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:04 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:05.557140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:05.559241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:05.566926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:05.567741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:05.568343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:05.569232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:05.569838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:05.570409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:05.762130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:05.770854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-639adacd-af26-4ac1-85a5-6e9bd0db5b41 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.217592 Oct 03 16:01:05.771415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 137/261] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:05 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:06.331129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:06.331621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:06.340109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.340847 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.341412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.342602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.343065 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.343565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.386652 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:06.390957 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6251fb9-a791-46e2-8d78-dae20234e7c1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/ips" status: 200 len: 150 microversion: 2.20 time: 0.064535 Oct 03 16:01:06.391535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 125/262] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Oct 3 16:01:06 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/ips => generated 150 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 16:01:06.800352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:06.801022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:06.806904 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.807583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.808410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.809809 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.810616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.811202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.867825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:06.874520 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:06.877578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:06.891723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.892430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.893087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.894129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:06.894757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:06.895326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:06.923127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'flavor' on Instance uuid 7100bc2d-5133-4f37-a224-1eba62ee2aab {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:01:07.041503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e8447e0-b3c6-41ce-8559-8c4e5f2b9fed tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/action" status: 200 len: 32 microversion: 2.1 time: 0.178983 Oct 03 16:01:07.042114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 126/263] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:01:06 2022] POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 16:01:07.052710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:07.053352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:07.059843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:07.060443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:07.060864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:07.061650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:07.062096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:07.062509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:07.249372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:07.256493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:07.256971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d0be9a4-52cf-49bc-a4b1-8e22a5b492e9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.462883 Oct 03 16:01:07.257536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 138/264] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:06 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:07.268863 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96c26927-4dca-4e16-a067-3ed1ad7bbad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.219297 Oct 03 16:01:07.268863 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 127/265] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:07 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:08.280504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:08.281130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:08.287506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.288018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.288452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.289160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.289665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.290071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.290777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:08.291496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:08.298476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.299048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.299540 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.300304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.300852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.301333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.488285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:08.496045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46a93e6f-088b-43dc-ba59-a66db4a91f77 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.219455 Oct 03 16:01:08.496609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 128/266] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:08 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:08.503038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:08.510927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c1c9ee1-2450-4c6e-9188-75bf202bbabd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.224525 Oct 03 16:01:08.511485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 139/267] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:08 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:09.519821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:09.520355 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:09.526755 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.527249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.527687 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:09.528367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.529860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.530068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:09.534409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:09.535272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:09.541279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.541783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.542216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:09.542926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.543379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.543819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:09.741664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:09.745670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:09.751050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba6641f0-150d-4b5f-b169-2c5beb9b62dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.235096 Oct 03 16:01:09.751765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 129/268] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:09 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:09.756029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec489768-7223-44dc-9b35-fcd082806ace tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.225379 Oct 03 16:01:09.756596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 140/269] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:09 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:10.776047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:10.776672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:10.781326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:10.782693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:10.789717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:10.790576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:10.791560 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:10.792492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:10.793652 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:10.795124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:10.796953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:10.797420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:10.798177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:10.799019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:10.802926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:10.803492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.129431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:11.133930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:11.150086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9107363-cf89-45ff-999a-896a12592c5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.370867 Oct 03 16:01:11.160802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 141/270] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:10 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:11.166658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91d54378-dae5-4b96-bbc2-67b4898611f2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.394382 Oct 03 16:01:11.167407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 130/271] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:10 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:11.530651 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:11.532711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:11.539158 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:11.539638 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:11.540868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.632046 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 16:01:11.688687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af5bfa6a-deaf-48e6-bf31-2abf85356366 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action" status: 202 len: 0 microversion: 2.1 time: 0.161663 Oct 03 16:01:11.692215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 142/272] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:01:11 2022] POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:01:11.697774 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:11.698531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:11.707845 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:11.708417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:11.708976 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.709674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:11.710314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:11.712148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.951759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:11.962550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a54a561a-cc31-43bb-89ba-c725672d08b3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.268913 Oct 03 16:01:11.964391 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 131/273] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:11 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:12.175190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:12.176215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:12.183565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.184514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.190400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:12.191363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:12.195048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.208307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.209995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.210729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.211868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.213287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.217766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.218864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.219550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.220201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.257777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:12.597166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:12.597374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:12.604886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22c3010e-94ca-4f8f-ba9c-c93ffb42a76b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.418230 Oct 03 16:01:12.606627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 132/274] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:12 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:12.607923 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d9bfc23-16de-4b46-9a57-7347dbf1b471 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.436940 Oct 03 16:01:12.612759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:12.613293 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:12.613788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 143/275] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:12 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:12.640097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.640587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.641080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.641827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.642298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.642745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.678553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lazy-loading 'flavor' on Instance uuid c36b3edc-789f-4598-973a-889f9678a395 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:01:12.991539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:12.992039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:13.009226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.013560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.014312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.015064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.015533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.015963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.232448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:13.242980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-963664eb-ecd6-46bc-b4f5-3a307d6aa8be tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.255303 Oct 03 16:01:13.243486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 144/276] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:12 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:13.630062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:13.635048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:13.646324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.646813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.647240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.647930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.650557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.652405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.836239 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:13.846017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-651b1159-79b0-4f44-84cb-c1572979e5a9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.220399 Oct 03 16:01:13.849301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 145/277] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:13 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:13.856084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:13.860219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:13.885300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.888403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.890040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.892448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.894143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.894564 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.150684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:14.168052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5f71ba4-6045-41f7-bb9d-bb1ce123b308 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.313099 Oct 03 16:01:14.170133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 146/278] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:13 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:14.270184 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:14.270976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:14.283729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.286523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.288444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.289419 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.290082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.290880 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.526254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:14.541611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdafc3dc-8bd6-45fa-95ce-1173a37b2525 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.276932 Oct 03 16:01:14.542563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 147/279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:14 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:14.557456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "name": "network-vif-plugged", "status": "completed", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:14.572578 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.573462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.574056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.588422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] Creating event network-vif-plugged:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:01:14.604161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0558aca5-c335-4ff1-a35b-2af77ee33828 req-1638df2b-f000-47c6-80e3-6f4226753b5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060136 Oct 03 16:01:14.605125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 148/280] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:14.857684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61d15c2f-7ff0-4152-b482-2c3cb70f8cd2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/action" status: 202 len: 0 microversion: 2.20 time: 2.248534 Oct 03 16:01:14.858657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 133/281] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 16:01:12 2022] POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/action => generated 0 bytes in 2251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:01:14.871649 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:14.873188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:14.875042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:14.876001 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:14.883780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.884553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.885221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.886131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.886764 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.887378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.889649 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.890986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.894212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.895370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.896034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.896925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.219829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.225983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.229578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ac30e04-409c-48d5-a531-534ddfd471d3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.359347 Oct 03 16:01:15.238669 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.241312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.243225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73c6ca06-151a-4cd8-bab1-4055aeffcc12 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.380337 Oct 03 16:01:15.243770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 149/282] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:14 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:15.248795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:15.249812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:15.257139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 134/283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:14 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:15.257540 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.258242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.258885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.260560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.262212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.263402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.413756 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.427808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38271dd2-c392-4cb9-8d3a-b67e1c05a972 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.182777 Oct 03 16:01:15.428886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 150/284] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:15 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:15.569716 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:15.570339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:15.584596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.584947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.585559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.586446 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.587240 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.587826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.750190 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:15.763763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8183d9fa-b057-4d8d-b07d-cd0a228bb498 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.199604 Oct 03 16:01:15.773448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 135/285] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:15 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:16.255155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:16.256120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:16.262172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.262726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.263136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.263826 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.264278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.264761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.271816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:16.272426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:16.279574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.280052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.280507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.281215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.281665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.282078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.526187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.537870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.541623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0835bb2d-91f6-4f09-84a3-9a5d17339cce tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.290238 Oct 03 16:01:16.542465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 151/286] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:16 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:16.562083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.562336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:16.562872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:16.564681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.566196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f056fb28-1109-415b-a238-046d87fceb02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.298391 Oct 03 16:01:16.567056 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 136/287] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:16 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:16.569974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.570461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.570963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.571659 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.572108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.572756 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.753201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.765293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f5da080-aabb-4b43-b217-2b52f6dbbdf6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.221478 Oct 03 16:01:16.765949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 152/288] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:16 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:16.791739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:16.792588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:16.799781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.800314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.800760 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.801795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:16.805625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:16.806112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.002833 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.017674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb4efb97-ac54-4653-8441-347812756da8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.230763 Oct 03 16:01:17.018781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 137/289] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:16 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:17.565698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:17.566339 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:17.572501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.573198 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.573814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.574680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.575400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.575978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.598864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:17.601129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:17.611551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.612494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.613308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.614198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.614829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.615398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.645024 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:17.792637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.805295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c583b112-1efe-42a9-855b-8d5cfd58f355 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.243350 Oct 03 16:01:17.810966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 153/290] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:17 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:17.826466 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.835871 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.837631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.837761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:17.838468 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:17.838801 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1176ecf8-1055-4a74-81b5-cdfabf267b91 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.248685 Oct 03 16:01:17.839352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 138/291] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:17 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:17.846258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.847062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.847723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.848683 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.849414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.850628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.006563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:18.016391 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9bf07f39-2c5b-4535-b79c-e1425b1b901f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.203886 Oct 03 16:01:18.017105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 154/292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:17 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:18.042396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:18.043279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:18.049993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.050485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.050944 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.051763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.052224 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.052680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.196445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:18.209531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06a8225f-a282-49b2-9f57-ada2954a1e45 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.170808 Oct 03 16:01:18.210112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 139/293] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:18 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:18.833119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:18.833864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:18.852755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.853257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.853690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.854399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.854849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.857432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.867749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:18.869173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:18.877893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.878628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.879238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.881088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.881707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.882874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.081440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.084767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.094226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63f7bffd-7076-4236-ad0b-20d44d1209ed tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1258 microversion: 2.1 time: 0.265190 Oct 03 16:01:19.095100 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 155/294] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:18 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1258 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:19.101716 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.103929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.107061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa3f4c46-3a4a-4453-b8ba-bddb91512c79 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.245069 Oct 03 16:01:19.108584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:19.109532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:19.110724 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 140/295] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:18 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:19.118281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.119486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.120162 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.121033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.121695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.122239 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.239236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:19.240206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:19.246770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.248997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.249664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.250592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.251236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.251850 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.281074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.291544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01e176e1-bd9f-4785-8faf-4b42a61cf255 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.192507 Oct 03 16:01:19.292705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 156/296] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:19 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:19.434272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.448564 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a3971a1-e7ee-47e8-8ea0-7a4da4708c96 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.208663 Oct 03 16:01:19.449267 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 141/297] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:19 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:20.119346 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.120588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.129672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.130687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.131427 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.132237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.133603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.134448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.139653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.140263 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.148831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.149326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.149764 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.150468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.150919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.151337 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.351385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.362280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96fcd9e4-4957-478b-8cd5-f11c5d544aaf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1442 microversion: 2.1 time: 0.247571 Oct 03 16:01:20.363600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 157/298] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1442 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:20.364902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.374297 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.376608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.378035 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-685df48d-a961-4d85-aaae-242a5dfcc6a7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.242689 Oct 03 16:01:20.379334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.380307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.389469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 142/299] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:20.395268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.396031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.396384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.396673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.397223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.398281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.398974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.400023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.404876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.405365 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.405800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.406493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.406939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.407356 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.631730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.639142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.649902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebc1ef9e-6ff9-417b-aef5-27abd6a93451 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.284024 Oct 03 16:01:20.660741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 158/300] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:20.661073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3cd3af0-03fb-4d99-9d2a-ed311c7c4c27 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1442 microversion: 2.1 time: 0.267906 Oct 03 16:01:20.661073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 143/301] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1442 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:20.668785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.668785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.684983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.687075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.687852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.690609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.691465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.692131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.864020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.876466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a840e1a5-3aed-4625-8215-b5d927401883 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.224587 Oct 03 16:01:20.877398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 159/302] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:21.404347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:21.404962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:21.424230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.424815 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.426401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.427116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.429126 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.429569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.677663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:21.678587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:21.687092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.687598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.691474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.692264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.692776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.693837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.726665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:21.739268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:21.740730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:21.741896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b8ec5bc-c527-42f3-94eb-25402f138d2c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.342932 Oct 03 16:01:21.742637 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 144/303] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:21 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:21.901030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:21.902401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:21.912439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.913145 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.913864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.915887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.916743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.917499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.977021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:21.983889 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:21.986308 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb80c885-ee75-4ec9-b5fa-a32363c66a21 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.312506 Oct 03 16:01:22.005170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 160/304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:21 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:22.491624 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:22.503176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d91a795-f7c1-4d3b-9c3b-a484a4f163b7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.606024 Oct 03 16:01:22.503912 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 145/305] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:21 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:22.771573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:22.772172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:22.779749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:22.780223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:22.780860 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:22.782179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:22.782641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:22.783237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.015174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:23.015905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:23.031753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.032536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.034299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.035288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.036646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.037271 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.100091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.109075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.110873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.112291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3dd1b9a5-8d4f-4f87-b32a-7e730bbadaa1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.345041 Oct 03 16:01:23.113373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 161/306] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:22 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:23.311238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.337525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8bd3270-0040-4fc3-8ec2-e0d7f4019963 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.326632 Oct 03 16:01:23.338607 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 146/307] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:23 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:23.532971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:23.536313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:23.537009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:23.565186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.565787 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.566250 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.567353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.568376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.569017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.569154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.569722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.569989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.587304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] Creating event network-changed:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:01:23.600512 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c917db83-f725-4ef5-9f23-2fd421022de5 req-b9d2a7e8-d06b-4164-99f5-f2c6d8b4ef6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078842 Oct 03 16:01:23.605657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 162/308] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:23.866134 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.883911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e5e082d-6363-48eb-ada6-268eb5c24495 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.360036 Oct 03 16:01:23.885917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 147/309] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:23 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:24.148594 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:24.150538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:24.159954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.160665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.161471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.163374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.164042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.164712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.370514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:24.371390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:24.387462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.389345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.390640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.393019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.395142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.396705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.443629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:24.455417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:24.457175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:24.462232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-008ec509-7e81-420b-a1fc-d9e22fb03f94 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.321035 Oct 03 16:01:24.463546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 163/310] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:24 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:24.756161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:24.781203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59a341ef-47e6-4f44-8ecc-2f294c7e4992 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.414702 Oct 03 16:01:24.784527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 148/311] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:24 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:24.908560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:24.909197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:24.915673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.916433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.917175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.918117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.919803 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.920461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.127331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.138841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fd1cb06-9f90-40f5-81f6-3a0c1282aad0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.234591 Oct 03 16:01:25.140018 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 164/312] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:24 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:25.494569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:25.495179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:25.501917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.502420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.502857 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.503538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.503989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.504407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.656566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.664754 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.666186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.667358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58642e2d-f1bd-4d31-beac-2ff6e01435ac tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.176871 Oct 03 16:01:25.667901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 149/313] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:25 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:25.806451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:25.807122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:25.815112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.815407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.816377 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.817424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.818031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.818785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.987451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.996130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80ba1711-bd7a-4947-b133-afb88ba76f4e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.194129 Oct 03 16:01:26.013831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 165/314] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:25 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:26.170473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:26.172685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:26.180834 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.181501 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.182295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.183448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.184983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.185563 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.475688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:26.487871 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04227311-b38e-4ad4-ac99-97b2029285ba tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.321459 Oct 03 16:01:26.489078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 150/315] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:26 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:26.694421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:26.695033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:26.706318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.706877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.707348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.711056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.711954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.712542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.907317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:26.947284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:26.949192 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:26.951663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17a08968-39a9-48aa-9410-598c65591c1a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.262475 Oct 03 16:01:26.953267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 166/316] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:26 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:27.025646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:27.026319 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:27.033774 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.034665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.035400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.036304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.036802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.037400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.257419 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:27.266682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-08e1bbec-ac3e-474d-a02c-bcc8fa6aeadc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.248036 Oct 03 16:01:27.267834 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 151/317] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:27 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:27.513141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:27.513955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:27.521115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.521968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.522578 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.523456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.524185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.524617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.720305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:27.729869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-282c9c34-077c-484e-8fd3-dcbe09dabfd9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.220722 Oct 03 16:01:27.731042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 167/318] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:27 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:27.979399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:27.980411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:27.989076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.990012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.990666 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.991470 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:27.992493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:27.993148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:28.164788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:28.174222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:28.175700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:28.177529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72110562-5069-4b08-a8ab-eec8d114340e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.203151 Oct 03 16:01:28.178251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 152/319] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:27 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:28.291397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:28.293688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:28.305612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:28.307278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:28.311628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:28.312652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:28.313346 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:28.314136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:28.609507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:28.623546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27d27e1e-26f4-4359-bf18-9aef74eb8064 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.336961 Oct 03 16:01:28.642616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 168/320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:28 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:28.759158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:28.761149 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:28.774548 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:28.775150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:28.777456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:28.778898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:28.781875 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:28.782582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.206955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:29.207851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:29.218200 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:29.239000 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:29.248313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:29.251043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.252437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6633bec9-6f50-478b-a1ee-b2b24fea1b79 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.502100 Oct 03 16:01:29.254661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 153/321] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:28 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:29.255623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:29.256692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:29.257631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.566103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:29.585040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:29.589320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:29.592822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29d9bcba-e336-4c20-b5f3-4495868cc750 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.391092 Oct 03 16:01:29.594623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 169/322] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:29 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:29.648173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:29.650662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:29.661254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:29.663762 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:29.664416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.667140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:29.669219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:29.670540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.890267 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:29.906572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30ad5400-d045-46ab-9f94-aba8e2b9e5f5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.260923 Oct 03 16:01:29.925983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 154/323] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:29 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:30.276545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:30.277925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:30.291351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.292183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.292877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:30.294717 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.295157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.295905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:30.444758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:30.454441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4c705e7-f44e-407d-8322-33e1e10042c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.182203 Oct 03 16:01:30.455043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 170/324] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:30 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:30.619721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:30.620554 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:30.627876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.628469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.629002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:30.629769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.630290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.630777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:30.634013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:30.798574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:30.807678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:30.809203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:30.810371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-191bd7c0-311c-4ffa-a170-823b445d6689 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.194586 Oct 03 16:01:30.820988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 155/325] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:30 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:30.930983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:30.932095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:30.939026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.939509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.939935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:30.940633 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:30.941106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:30.941702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:31.091063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:31.101167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbbd18e1-de4c-44e0-9e59-1c59e98cbae3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.173943 Oct 03 16:01:31.108776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 171/326] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:30 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:31.486396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:31.487073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:31.493609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:31.494578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:31.495032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:31.495683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:31.496131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:31.497288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:31.659763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:31.668215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf696c8d-2c74-4546-aea9-776d87626a78 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.191277 Oct 03 16:01:31.684477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 156/327] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:31 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:31.836658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:31.837612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:31.844363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:31.845159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:31.845851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:31.846768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:31.847449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:31.848085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:31.992518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:32.002781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:32.004264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:32.005475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8f434fb-e51c-4555-9d2d-3c28c5066104 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.172727 Oct 03 16:01:32.006508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 172/328] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:31 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:32.128789 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:32.129824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:32.177274 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:32.181010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:32.187318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:32.192266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:32.193057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:32.193880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:32.474091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:32.488910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-719e95b7-710b-4bcd-8518-89a89ef5daa2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.369216 Oct 03 16:01:32.490478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 157/329] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:32 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:32.692471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:32.693678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:32.702897 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:32.704009 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:32.704864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:32.705954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:32.706819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:32.707479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:32.998031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:33.011939 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25415f1a-3b96-4b41-b378-6cb51f540da3 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.323887 Oct 03 16:01:33.029034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 173/330] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:32 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:33.036400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:33.037532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:33.052138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:33.052911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:33.055457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:33.056393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:33.057989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:33.058590 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:33.322552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:33.333290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:33.335230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:33.336816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d721824a-6b10-424e-be03-6fef240c7dcc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.309338 Oct 03 16:01:33.337605 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 158/331] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:33 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:33.527418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:33.536600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:33.546812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:33.547600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:33.548873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:33.550751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:33.553522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:33.557585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:33.883264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:33.903585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f463228-1e83-4ca0-9dc1-1adbb25d4971 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.385118 Oct 03 16:01:33.920323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 174/332] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:33 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:34.039311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:34.040032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:34.051223 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.051633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.052368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:34.053275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.054171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.054746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:34.319408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:34.332752 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f73d45a-4b74-4837-80f6-3a041b11a027 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.297247 Oct 03 16:01:34.342090 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 159/333] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:34 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:34.366994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:34.367597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:34.379352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.380317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.381063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:34.383024 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.383757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.384335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:34.644153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:34.654782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:34.656611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:34.658023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30f8e3e3-fdec-4b6e-9792-5d53bfa35d81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.295104 Oct 03 16:01:34.658871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 175/334] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:34 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:34.931145 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:34.932040 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:34.944775 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.945693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.947337 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:34.950220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:34.952126 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:34.953541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:35.362322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:35.363110 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:35.375487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:35.377229 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:35.378918 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:35.380543 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:35.381218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:35.383083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:35.508383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:35.520347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a3844f9-91db-4333-af29-97f15a92cb19 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.593555 Oct 03 16:01:35.522118 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 160/335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:34 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:35.689289 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:35.690147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:35.705051 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:35.705939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:35.706316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:35.707262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:35.707933 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:35.708507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:36.012473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:36.023571 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4f1717a-c817-4f55-9e49-3625adb19b91 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.665508 Oct 03 16:01:36.024264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 176/336] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:35 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:36.098794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:36.114938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:36.119364 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:36.122541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb99685b-9c1b-4560-84f4-5f8c51acec8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.439122 Oct 03 16:01:36.123809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 161/337] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:35 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:36.547613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:36.548866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:36.562975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:36.563555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:36.564140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:36.565020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:36.565974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:36.567495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:36.870335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:36.889092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e9659bc-d89e-4a8f-8bc1-a0b4229db628 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.344416 Oct 03 16:01:36.891456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 177/338] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:36 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:37.048910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:37.049667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:37.055262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=72 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:37.083325 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.084045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.084701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:37.085671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.087588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.088207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:37.155455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:37.158720 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:37.188687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.195757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.196872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:37.198580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.202866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.203663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:37.209997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:37.611264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:37.630896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:37.637500 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7096cb16-0a2c-4674-8052-d2e22382e56a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1723 microversion: 2.1 time: 0.592550 Oct 03 16:01:37.638212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 162/339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:37 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:37.652125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:37.654180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:37.655539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78af8533-ba9f-4108-94cd-4d3a97b579ff tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1744 microversion: 2.20 time: 0.506418 Oct 03 16:01:37.672905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 178/340] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:37 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1744 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:37.914928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:37.915676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:37.923375 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.924277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.925512 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:37.926757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:37.928017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:37.928469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:38.199891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:38.209662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2c7bf0c-95cc-4961-b739-e5636a605d47 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.300003 Oct 03 16:01:38.210977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 163/341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:37 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:38.520962 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "name": "network-vif-plugged", "status": "completed", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:38.539442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:38.540341 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:38.541154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:38.579214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] Creating event network-vif-plugged:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:01:38.593465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0e0b21ed-a7a3-4109-890e-617a2ad599ee req-99898eb0-382e-4fc5-9063-fed4b1a901d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076488 Oct 03 16:01:38.594386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 179/342] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:38.667188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:38.668515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:38.682045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:38.683953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:38.690091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:38.690695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:38.694186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:38.695184 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:38.695785 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:38.697251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:38.698085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:38.699712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:38.704140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:38.705617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:38.706416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:38.707867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.068195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.078048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.084654 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7e2dbcd-f810-4f2b-ac5d-3f6cc7103f10 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1700 microversion: 2.1 time: 0.424856 Oct 03 16:01:39.086951 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.089622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 164/343] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:38 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1700 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:39.090954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.092631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02aeca76-9adf-4d65-b1e9-18ddcca2caab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1744 microversion: 2.20 time: 0.415866 Oct 03 16:01:39.093410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 180/344] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:38 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1744 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:39.116631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:39.130474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:39.131062 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:39.131584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.212674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 16:01:39.235484 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:39.236347 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:39.247191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:39.248584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:39.248584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.249351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:39.250553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:39.251163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.295351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-607f0d6a-fd9e-48d3-8e0f-607cbf54bbc9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action" status: 202 len: 0 microversion: 2.1 time: 0.185436 Oct 03 16:01:39.296330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 165/345] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:01:39 2022] POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:01:39.324944 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:39.325952 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:39.332167 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:39.332655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:39.333877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.335635 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:39.336096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:39.336518 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:39.542030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.555780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4154346e-5d78-47e1-8bcf-8220da229832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.325381 Oct 03 16:01:39.559109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 181/346] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:39 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:39.611359 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:39.623198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac59eec6-f927-48a4-b8ec-ce468c2badbb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.315088 Oct 03 16:01:39.641525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 166/347] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:39 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:40.141958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:40.143264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:40.151284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.152110 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.153335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.154874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.155537 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.156244 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.356060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:40.373855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:40.375209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:40.376387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17820881-ce97-4d7a-8eb4-f6a6d62d6bec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1744 microversion: 2.20 time: 0.239956 Oct 03 16:01:40.377104 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 182/348] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:40 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:40.581704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:40.583061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:40.590677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.592077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.592780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.593717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.594386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.595029 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.650225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:40.651697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:40.668843 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.669703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.670364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.671792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:40.672439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:40.673142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:40.840378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:40.856125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bc43b49-e743-43bc-abe6-06e935c812ac tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.277812 Oct 03 16:01:40.857414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 167/349] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:40 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:40.898844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:40.908412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fe996b6-032d-4ea8-b50e-8983b87929bf tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.264766 Oct 03 16:01:40.909476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 183/350] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:40 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:41.370210 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a18e7662-3242-486b-a2ce-0c69dc65b955 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Action: 'create', calling method: .version_select at 0x7f8175100040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-215967939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh2Ikt5cZRTXPl8R4rK7BdVnS5zF7RJz08E8HhxOmMkK8POOvXn5qZ0wLCoa7VnufrAuUxhflzXNi0rCiNKTqBE9TA6Sx+bxLi2335Hwqd7q2d65aZgMa/mFOdAtf/Kfw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:41.387711 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-a18e7662-3242-486b-a2ce-0c69dc65b955 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for project 40732e98240b4797b941e57f6606e6c5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:01:41.391788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-a18e7662-3242-486b-a2ce-0c69dc65b955 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for user 7377a1bca391446eb36b2a3233a7d471 and project 40732e98240b4797b941e57f6606e6c5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:01:41.405587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:41.406223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:41.413368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.413848 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.414283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:41.415041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.415676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.416102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:41.416298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a18e7662-3242-486b-a2ce-0c69dc65b955 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.226278 Oct 03 16:01:41.417091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 168/351] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:01:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:41.599260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:41.615750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:41.617256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:41.618623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be54a2e9-addf-4eb4-9a0b-17563284fc74 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1744 microversion: 2.20 time: 0.220121 Oct 03 16:01:41.620018 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 184/352] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:41 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:41.885408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:41.886240 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:41.895632 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.896373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.896856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:41.897917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.898494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.898964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:41.934788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:41.935870 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:41.952942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=86 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:41.955270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.956097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.956812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:41.957807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:41.958443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:41.959045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:42.269509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:42.273583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:42.284226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed9f0e64-4f02-43b9-8641-cbcd6d82c3b5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.403964 Oct 03 16:01:42.285267 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 169/353] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:41 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:42.294925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aaaa1105-fdbc-4b12-893f-818237064c43 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.366108 Oct 03 16:01:42.295813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 185/354] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:41 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:42.647333 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:42.647967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:42.669945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:42.670595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:42.671298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:42.672350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:42.673302 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:42.674461 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:42.848441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:42.858494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:42.860841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:42.862442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77ce2754-3a0a-4e29-a2c0-17dc4e4c206a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1744 microversion: 2.20 time: 0.221477 Oct 03 16:01:42.863556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 170/355] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:42 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:43.326120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:43.327447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:43.334693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:43.336146 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:43.339187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:43.340227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:43.343688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:43.346650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:43.347648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:43.349523 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:43.349690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:43.350478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:43.351387 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:43.352501 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:43.358266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:43.364703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:44.136283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:44.145616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:44.149707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:44.160090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-564c860e-1cca-4a9a-b9bf-8d41a8a27fd8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.838325 Oct 03 16:01:44.161383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f429846c-1b21-45d2-9e48-0bca59214d1d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.832750 Oct 03 16:01:44.161954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 186/356] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:43 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:44.162230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 171/357] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:43 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:44.176180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:44.177497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:44.197363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:44.198183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:44.198795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:44.200105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:44.200759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:44.201363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:44.419763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:44.441498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:44.446108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:44.447956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f0b6d56-418d-4c3e-b4fb-04b1e8dc2d7d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.284500 Oct 03 16:01:44.448562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 187/358] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:44 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:45.199900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:45.201290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:45.204862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:45.205535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:45.218757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.219280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.219749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.220466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.220961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.221387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.221711 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.223372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.225442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.226427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.230798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.231774 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.477118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:45.486515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21deeab8-45c6-439c-84c7-cb1035518c3f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.287666 Oct 03 16:01:45.487078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 188/359] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:45 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:45.500381 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:45.503441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:45.519871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.520378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.520930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.522373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:45.522838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:45.523781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:45.549067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:45.560678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce38bab9-ef48-4d8a-8487-9fceff0f21a8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.363939 Oct 03 16:01:45.562074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 172/360] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:45 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:45.762382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:45.782737 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:45.798675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:45.800186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-faa0563c-7d21-4def-9cde-43efe100565c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.307916 Oct 03 16:01:45.801640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 189/361] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:45 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:46.519713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:46.520937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:46.529770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:46.530687 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:46.531312 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:46.532228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:46.532913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:46.533719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:46.585027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:46.585602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:46.600515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:46.601042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:46.601612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:46.602335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:46.603095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:46.603532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:46.934917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:46.944299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-938e7cfb-f7fa-4c38-a9a5-29b38567b264 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1709 microversion: 2.1 time: 0.435908 Oct 03 16:01:46.969406 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 173/362] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:46 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1709 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:46.983376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:46.985742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:47.006235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:47.020497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.021311 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef54376f-aae7-4c39-8366-937f530932c3 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1500 microversion: 2.1 time: 0.438716 Oct 03 16:01:47.022827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 190/363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:46 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1500 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:47.023985 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.024607 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.025449 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.025914 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.026339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.062224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "204ea628-5fc6-4414-95be-e6b87c299997"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:47.076522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:47.085666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.087131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.112989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.113943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.114408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.114839 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.190270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] HTTP exception thrown: Cannot 'attach_volume' instance 7100bc2d-5133-4f37-a224-1eba62ee2aab while it is in vm_state rescued Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Request method failure captured: Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/os-volume_attachments HTTP/1.1 Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 74 Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbVZaQBQ2APGHTbpDb8MfEnlC_Hu8J1x4rJLy299mha70Q2e7JP4CM2b9nqMz9n5mWCa8mXe4MTXeIh-s5fjaSy9lCgAUJm6GQcdTUwwCgEqTW1aVX6MoTHYyTpP_TipQYNbeaQAwwdyqMVcUtOBg5lSip8LwroudXuhkI4Y9cUNrk Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:01:47.192531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2ed0fa1c2fe47a485c26522b2e81b8b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: b3098a7103d94b29bc4bce30cfd05bc6 Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "204ea628-5fc6-4414-95be-e6b87c299997"}} Oct 03 16:01:47.194076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Cannot 'attach_volume' instance 7100bc2d-5133-4f37-a224-1eba62ee2aab while it is in vm_state rescued Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'server_id': '7100bc2d-5133-4f37-a224-1eba62ee2aab', 'body': {'volumeAttachment': {'volumeId': '204ea628-5fc6-4414-95be-e6b87c299997'}}} Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:01:47.194792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7100bc2d-5133-4f37-a224-1eba62ee2aab while it is in vm_state rescued Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:01:47.195973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:01:47.197115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:01:47.197115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:01:47.197115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7100bc2d-5133-4f37-a224-1eba62ee2aab while it is in vm_state rescued Oct 03 16:01:47.197115 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:01:47.199413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Returning 409 to user: Cannot 'attach_volume' instance 7100bc2d-5133-4f37-a224-1eba62ee2aab while it is in vm_state rescued {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:01:47.200648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e469ee9a-fdc5-492a-b3f3-47e9b89a61bb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.152924 Oct 03 16:01:47.201853 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 191/364] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:01:47 2022] POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/os-volume_attachments => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 16:01:47.218214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:47.220052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:47.230789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.235545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.236326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.238483 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.242347 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.243048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.340674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:47.362405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:47.365223 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:47.368902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc11b361-280c-4336-aaa7-7b6c395a046b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.393884 Oct 03 16:01:47.369678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 174/365] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:46 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:47.420243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-143a3634-b9c5-4a56-a6dd-b7ed8c56ec5d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/action" status: 202 len: 0 microversion: 2.1 time: 0.213156 Oct 03 16:01:47.421267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 192/366] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:01:47 2022] POST /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 16:01:47.434513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:47.435175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:47.471522 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.471916 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.474690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.475732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:47.476397 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:47.476890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:47.956657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:47.966819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d92210a7-307e-44e9-9579-a3cc6578cce2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1508 microversion: 2.1 time: 0.540732 Oct 03 16:01:47.970463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 175/367] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:47 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:47.987104 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:47.987905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:48.003777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:48.004620 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:48.005409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:48.007787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:48.008515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:48.009722 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:48.383181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:48.404296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:48.405409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:48.410016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-203e05f5-324a-45d4-acfe-432f3be13915 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1713 microversion: 2.1 time: 0.429145 Oct 03 16:01:48.415388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:48.415973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 193/368] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:47 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1713 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:48.421848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:48.427604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:48.431020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:48.435508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:48.437568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:48.862927 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:48.874361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:48.875870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:48.889390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8134f94-1aa9-42b9-aafe-46044d7d510f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.485736 Oct 03 16:01:48.911212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 176/369] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:48 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:49.033839 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:49.036195 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:49.056294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:49.057435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:49.059507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:49.061711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:49.062621 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:49.063313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:49.348248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:49.350628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:49.358707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0dc0703-2ccc-4dc0-a8f6-0f51e1838f5a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1508 microversion: 2.1 time: 0.366613 Oct 03 16:01:49.359276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 194/370] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:48 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:49.754674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1544405527", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "networks": [{"uuid": "2eb47dc5-6e8d-4486-b34c-6986a542da63"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:49.922273 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:49.923415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:49.931734 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:49.932471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:49.933193 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:49.934749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:49.935447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:49.936220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:50.142549 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:50.153593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:50.155242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:50.156903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-144b1e14-b669-4428-8443-064fa5dec673 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.242009 Oct 03 16:01:50.169242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 195/371] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:49 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:50.383959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:50.384622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:50.391433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:50.391924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:50.392349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:50.393274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:50.393727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:50.394149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:50.541695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:50.557878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ec90533-d1be-4b4c-b5c9-1ee0238c7ec2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1508 microversion: 2.1 time: 0.178060 Oct 03 16:01:50.559299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 196/372] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:50 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:51.185618 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:51.187080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:51.203482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:51.205503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:51.210805 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:51.211744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:51.212323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:51.213929 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:51.400496 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:51.414137 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:51.423509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:51.425387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:51.426787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-188405c0-9fa4-4ebf-9c22-41bb8be6852e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.245983 Oct 03 16:01:51.427340 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 197/373] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:51 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:51.583629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:51.584235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:51.590900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:51.591758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:51.592604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:51.593600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:51.594057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:51.594480 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:51.764704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:51.773965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2222c0b-c32d-43fe-9539-4f4d3ca71bb5 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1514 microversion: 2.1 time: 0.194159 Oct 03 16:01:51.774747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 198/374] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:51 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:52.460984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:52.461730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:52.469598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:52.470325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:52.470957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:52.471670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:52.472133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:52.472566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:52.621660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:52.632479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:52.634233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:52.635625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50086bb0-200d-4f76-902e-9f47ac32be11 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.178596 Oct 03 16:01:52.637215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 199/375] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:52 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:53.344493 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa3da462-31f1-4781-a0de-03e6b68b03e9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: .version_select at 0x7f81750c2940>, body: {"keypair": {"name": "tempest-keypair-809123124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWTFFxIFyOHHKwnCBKuYleIr4wlr+clIwjNb28HG2M2QSdCO/Ypyg1bzQrPW/1WbpDigQw50bTj+LsgabMbKQ7F8oCRj5sjb4IHHDtzP085aeNk7GkJRGMOswN8It5gcA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:53.365431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-fa3da462-31f1-4781-a0de-03e6b68b03e9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:01:53.371608 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-fa3da462-31f1-4781-a0de-03e6b68b03e9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for user b3098a7103d94b29bc4bce30cfd05bc6 and project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:01:53.398942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa3da462-31f1-4781-a0de-03e6b68b03e9 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059023 Oct 03 16:01:53.406094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 200/376] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:01:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:53.663069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:53.663747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:53.670072 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:53.670752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:53.671190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:53.672079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:53.672541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:53.672995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:53.836685 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:53.851160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:53.852932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:53.854117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4f0d346-2f3c-45de-95a0-db31f7e97835 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.195021 Oct 03 16:01:53.855434 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 201/377] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:53 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:54.883457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:54.884491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:54.890804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:54.891481 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:54.892093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:54.893146 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:54.893763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:54.894186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:55.061524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:55.069905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:55.071443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:55.072590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-085ec084-f255-40c5-b6d0-e1dc392c9a9f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1739 microversion: 2.20 time: 0.193071 Oct 03 16:01:55.084743 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 202/378] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:54 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:01:55.084743 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263741670", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8944939a-3352-4658-bad6-12912f50f635"}], "security_groups": [{"name": "tempest-securitygroup--2134752286"}], "key_name": "tempest-keypair-809123124", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:57.224678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] validate_networks() for [('2eb47dc5-6e8d-4486-b34c-6986a542da63', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:01:57.358261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] validate_networks() for [('8944939a-3352-4658-bad6-12912f50f635', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:01:58.151795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:01:58.152429 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:01:58.152919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:01:58.153322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:01:58.153930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:01:58.162611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.163302 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.163723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.164611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.165428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.165854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.185349 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Getting quotas for project f8c41c14b0b3411d9b7e39e3983f2ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:01:58.189547 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Getting quotas for user 5d59791fcdee41149fce9b8a950963fc and project f8c41c14b0b3411d9b7e39e3983f2ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:01:58.208482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:01:58.212002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:01:58.268670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-102eaa06-e20e-43eb-b4a3-a75a0bd004d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.518384 Oct 03 16:01:58.268670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 177/379] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 8522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:01:58.269758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:58.270439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:58.280658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.281336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.281747 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.282456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.283092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.283670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.412913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:01:58.412913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:01:58.413448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:01:58.413956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:01:58.415087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:01:58.426884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.427376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.427815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.428567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:58.429034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:58.429460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:58.449794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:01:58.454594 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Getting quotas for user b3098a7103d94b29bc4bce30cfd05bc6 and project f2ed0fa1c2fe47a485c26522b2e81b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:01:58.468025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:01:58.470409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:01:58.520006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a83ad575-0416-464d-89e1-b7818e97092f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.445233 Oct 03 16:01:58.527291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 203/380] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:01:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:01:58.527608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:58.545046 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10e29f86-0617-4f86-b489-c890849b7c8b tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:58.546225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10e29f86-0617-4f86-b489-c890849b7c8b tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:58.578017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:58.579574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:58.580803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7315876-f1a4-4d6a-a263-908d98a80831 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1721 microversion: 2.20 time: 0.316742 Oct 03 16:01:58.581573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 178/381] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:58 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:58.592165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3b77878-75d1-4848-9b04-ef083cb97bec tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:58.592840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3b77878-75d1-4848-9b04-ef083cb97bec tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:58.652045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-10e29f86-0617-4f86-b489-c890849b7c8b tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:58.668216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10e29f86-0617-4f86-b489-c890849b7c8b tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1219 microversion: 2.1 time: 0.145860 Oct 03 16:01:58.684288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 204/382] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:58 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:58.685098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3b77878-75d1-4848-9b04-ef083cb97bec tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:58.690272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3b77878-75d1-4848-9b04-ef083cb97bec tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1245 microversion: 2.1 time: 0.103713 Oct 03 16:01:58.691716 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 179/383] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:58 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:59.608759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:59.609360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:59.616151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.616628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.617091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.617772 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.618227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.618678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.697076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:59.697824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:59.705075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.705638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.706148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.706913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.707443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.707944 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.778629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:59.782592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:59.786631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7565269-6630-479c-9b9e-dd2da750b8f0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1223 microversion: 2.1 time: 0.093667 Oct 03 16:01:59.787198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 180/384] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:59 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:01:59.791050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:59.793143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:59.793874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:59.794306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b869bd31-8f2d-4504-86f2-9f291b1cae17 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1721 microversion: 2.20 time: 0.190082 Oct 03 16:01:59.794673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:59.799299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 205/385] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:01:59 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:01:59.800828 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.801411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.801945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.802735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:59.803191 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:59.803619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:59.869073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:59.877044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2f192b9-8d94-41c8-9d67-52c2dffda5aa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1249 microversion: 2.1 time: 0.088131 Oct 03 16:01:59.877607 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 181/386] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:59 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:00.811352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:00.811995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:00.819956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:00.820901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.821834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.821962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:00.822740 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:00.831614 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.832310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.832779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:00.833479 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.833932 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.834353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:00.837287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.837869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.838444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:00.928798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:00.941455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85c7a5fd-f7bd-4e7d-9e71-fcf7597bdc4f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1215 microversion: 2.1 time: 0.134623 Oct 03 16:02:00.953376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 206/387] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:00 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:00.962826 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:00.963600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:00.970238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.970751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.971180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:00.971890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:00.972350 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:00.972806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:01.007561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:01.018460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:01.020418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:01.022278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06b68352-9e93-443a-a074-b072357592ca tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1721 microversion: 2.20 time: 0.207379 Oct 03 16:02:01.023604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 182/388] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:00 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:01.060291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:01.069890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c688beec-b369-4230-83ac-d325ec04bd53 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1241 microversion: 2.1 time: 0.115425 Oct 03 16:02:01.070713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 207/389] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:00 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:01.969878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:01.970621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:01.977354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:01.978065 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:01.978678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:01.979477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:01.980676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:01.981301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.053214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:02.053835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:02.060751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.061243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.061674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.062372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.062824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.063244 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.067578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:02.076403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37f5da46-0567-49fc-a3e8-51456405a896 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1277 microversion: 2.1 time: 0.110877 Oct 03 16:02:02.077133 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 183/390] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:01 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:02.095128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:02.095729 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:02.102386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.103120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.103607 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.104293 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.105020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.105657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.206606 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:02.214957 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c99b9288-10f4-4b92-9c65-51fb5f744b55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1297 microversion: 2.1 time: 0.123737 Oct 03 16:02:02.215533 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 184/391] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:02 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:02.320831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:02.330015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:02.346264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:02.356852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce9eb7ee-fc91-46d7-bb78-e84f05695f3c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1724 microversion: 2.20 time: 0.307393 Oct 03 16:02:02.358563 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 208/392] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:02 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:02.386193 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0319a5e7-4105-4260-912d-1dd268a8e313"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:02.389503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:02.407799 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.409413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.411153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.413894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.414630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.415160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.459974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "name": "network-vif-unplugged", "status": "completed", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:02.485860 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:02.486653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:02.487147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:02.517285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] Creating event network-vif-unplugged:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:02:02.529454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d5edaf13-b646-42b0-8880-f6b9676a8a32 req-49af518c-4877-4075-bb48-e972eac97578 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075800 Oct 03 16:02:02.533040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 209/393] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:02.958655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d692734-fa33-4113-8b29-b2e118f4ae38 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.577809 Oct 03 16:02:02.959890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 185/394] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Oct 3 16:02:02 2022] POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments => generated 188 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 16:02:03.103468 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:03.105412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:03.126995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.131442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.132210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.133312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.135180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.138275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.234208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:03.234767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:03.262188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.263435 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.265566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.267326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.267968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.268411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.381307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 16:02:03.435239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:03.467779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9b9ed73-c82b-42f4-9c0b-4dd1d122c98f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/action" status: 202 len: 0 microversion: 2.20 time: 0.238944 Oct 03 16:02:03.468562 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 186/395] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 16:02:03 2022] POST /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:02:03.473907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:03.474746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:03.482858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.483378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.483956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.484669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.485143 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.485710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.620388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:03.628988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36df229a-9685-4753-8f0e-a16387a9fd8b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1303 microversion: 2.1 time: 0.159189 Oct 03 16:02:03.629580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 187/396] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:03 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:03.643399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:03.651053 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:03.651988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:03.658105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fd9483f-9796-458b-9e41-1085632c5280 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.560005 Oct 03 16:02:03.659590 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.660063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 210/397] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:03 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:03.660538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.661060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.661956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:03.662494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:03.662984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:03.967999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:03.982027 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:03.983401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:03.985315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-abbbd9aa-d934-4bd5-b250-ecfef61c3940 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1750 microversion: 2.20 time: 0.340103 Oct 03 16:02:04.005542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 188/398] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:03 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1750 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:04.033341 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712d40fb-6814-434a-92d3-2fd4553169b1", "tag": "29128e72-e7bc-47c7-9fae-fb89b598c55b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:04.055782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:04.056466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:04.056995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:04.069884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] Creating event network-changed:29128e72-e7bc-47c7-9fae-fb89b598c55b for instance 712d40fb-6814-434a-92d3-2fd4553169b1 on hv-cinder-84456 Oct 03 16:02:04.075191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5db8d585-51ba-40e0-b4ca-5c1bd2337559 req-49b1657a-62d9-431d-ba7e-4073c69d5c2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045664 Oct 03 16:02:04.076232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 211/399] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:04.654651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:04.655257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:04.664409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:04.665823 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:04.667683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:04.668661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:04.669790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:04.670393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:04.685548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:04.686821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:04.695320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:04.696092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:04.696767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:04.697430 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:04.703200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:04.704019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:05.277156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:05.285174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5656450-26ef-42ed-83d2-92edf6b20bbd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.635193 Oct 03 16:02:05.285767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 189/400] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:04 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:05.290591 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:05.291408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:05.297221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:05.297690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:05.298311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:05.299275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:05.299930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:05.300860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:05.322536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:05.333910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a712fc6-377c-4354-aadf-00d3205b2e83 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.655665 Oct 03 16:02:05.334839 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 212/401] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:04 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:05.529067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:05.539821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:05.541430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:05.542739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e12fca8-9dc0-4dbb-8fd2-8256019df704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1752 microversion: 2.20 time: 0.255876 Oct 03 16:02:05.556817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 190/402] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:05 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:06.119391 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:06.129770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.130241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.130668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.141532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] Creating event network-changed:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:02:06.146374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7d51b488-f027-4677-ad79-aca46430020f req-ac3bdb53-eaa0-4a75-83c5-4adba6b81fda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030694 Oct 03 16:02:06.146926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 213/403] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:06.314072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:06.314697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:06.348530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.349783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.350582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.352211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.359756 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:06.360813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:06.366970 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.366970 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.372155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.372792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.373301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.374062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.374580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.375095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.876608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:06.884261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92ad326a-09ed-46a1-8899-632436d242a4 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.580719 Oct 03 16:02:06.884843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 191/404] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:06 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:06.890570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-336463743", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215967939", "security_groups": [{"name": "tempest-secgroup-smoke-1333872185"}], "block_device_mapping_v2": [{"uuid": "c3dbb74a-5dfb-47ea-9bda-2c7ff08840c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "13403649-4ce4-4f7b-972e-1b4b67982742"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:06.955911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:06.964536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c96fc40f-3152-4cbe-b5e6-e91bbabcc26a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.610178 Oct 03 16:02:06.965130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 214/405] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:06 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:06.972401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:06.973257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:06.988472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.989232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.989845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:06.990850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:06.991849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:06.992892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:07.145712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] validate_networks() for [('13403649-4ce4-4f7b-972e-1b4b67982742', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:02:07.415940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:07.425686 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:07.427118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:07.428269 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea2e7a2d-bfb7-4864-80e8-44e86140f4cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.462238 Oct 03 16:02:07.428842 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 215/406] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:06 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:07.514515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:07.704892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:02:07.705309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:02:07.705778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:02:07.706179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:02:07.706582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:02:07.716083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:07.716561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:07.717029 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:07.717749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:07.718201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:07.718623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:07.735292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:02:07.739044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for user 7377a1bca391446eb36b2a3233a7d471 and project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:02:07.794922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:02:07.796986 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3dbb74a-5dfb-47ea-9bda-2c7ff08840c9',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:02:07.908887 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:07.909798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:07.916023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:07.916940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:07.917424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:07.918309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:07.918758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:07.919182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:07.923485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:07.931700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2915b894-bbf2-44ec-b2ba-cec4e25972d4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.044715 Oct 03 16:02:07.933206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 192/407] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:02:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:02:07.943719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cea48638-f94b-4d4f-a0be-de77b51662a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:07.956365 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cea48638-f94b-4d4f-a0be-de77b51662a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:08.053239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cea48638-f94b-4d4f-a0be-de77b51662a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.063609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cea48638-f94b-4d4f-a0be-de77b51662a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1093 microversion: 2.1 time: 0.123232 Oct 03 16:02:08.065095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 193/408] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:07 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1093 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:08.070331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:08.070853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:08.077538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:08.078178 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:08.078754 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:08.080459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:08.081111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:08.082237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:08.115136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.123507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f48f10c-c97b-4666-b9c4-7ba92cedfe1d tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.219044 Oct 03 16:02:08.124108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 216/409] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:07 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:08.272110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.280157 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25d97c9a-6bf1-4b94-ac91-1d5d84e26a3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.213666 Oct 03 16:02:08.280736 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 194/410] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:08 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:08.454218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:08.454831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:08.460054 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:08.461911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:08.462586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:08.463170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:08.464295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:08.464707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:08.465095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:08.660424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:08.882911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.897855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.899843 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:08.902620 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-caf8d871-dca1-415d-b676-e42b04703bd5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.451976 Oct 03 16:02:08.903359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 217/411] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:08 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:09.093575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:09.094936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:09.107704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.108939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.111402 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.113784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.114420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.114856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.161935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:09.163172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:09.180084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.181485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.182164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.183397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.184037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.184678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.245938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:09.254508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61478c56-e06c-4546-a906-a500fc08cd4b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1191 microversion: 2.1 time: 0.166958 Oct 03 16:02:09.255098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 195/412] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:09 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1191 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:09.303745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:09.304872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:09.311577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.312917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.313549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.314280 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.314763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.315385 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.353525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:09.361368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-581094ec-a7c1-483e-ab21-350349f3e453 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.215019 Oct 03 16:02:09.361945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 218/413] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:09 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:09.447453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:09.458690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fa8cb78-97fd-4d8c-b425-b7417db1b1e2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.158724 Oct 03 16:02:09.460330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 196/414] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:09 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:09.929662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:09.930277 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:09.937645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.938136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.938573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:09.939278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:09.939729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:09.940152 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.143769 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:10.161732 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:10.163388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:10.164585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb4a4798-88f9-4fdc-b30b-efdf224b16c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.239176 Oct 03 16:02:10.181124 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 219/415] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:09 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:10.278800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:10.280524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:10.286983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.287460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.287917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.288809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.289256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.289671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.361187 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:10.384233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-79aabb10-1721-4b71-af68-5d6e79883355 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1209 microversion: 2.1 time: 0.110064 Oct 03 16:02:10.384610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:10.397463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 197/416] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:10 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:10.397720 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:10.397872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.399583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.402793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.404397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.406574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.408177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.486015 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:10.486744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:10.507642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.509680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.513000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.516332 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.521144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.521680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.758551 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:10.773205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-089a72eb-2559-4285-972c-c8453993b76e tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.390434 Oct 03 16:02:10.774027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 220/417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:10 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:10.836001 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712d40fb-6814-434a-92d3-2fd4553169b1", "name": "network-vif-plugged", "status": "completed", "tag": "29128e72-e7bc-47c7-9fae-fb89b598c55b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:10.868134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:10.871525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:10.874193 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:10.877577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:10.935824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] Creating event network-vif-plugged:29128e72-e7bc-47c7-9fae-fb89b598c55b for instance 712d40fb-6814-434a-92d3-2fd4553169b1 on hv-cinder-84456 Oct 03 16:02:10.955801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-030189ee-475d-43b7-85dd-2afdb0fa353d req-608c2773-07db-4231-b8c5-07f6bf0d123b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126560 Oct 03 16:02:10.962360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 221/418] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:11.193591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:11.194692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:11.208302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.209032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.209561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.210390 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.213972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.214560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.446492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.461656 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc0e1a28-e301-40ea-8bd6-bb85f0f399cc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.980001 Oct 03 16:02:11.462516 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 198/419] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:10 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:11.482149 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:11.483083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:11.493632 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.497877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.498526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.499428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.502605 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.503316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.506210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.518426 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.520490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.522288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-264186a0-e0f2-48c9-8885-68b42cc0d8a1 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.333152 Oct 03 16:02:11.523380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 222/420] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:11 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:11.672198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.680271 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4af47ed8-2269-4532-bcad-e5ed5714a63e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.213207 Oct 03 16:02:11.680851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 199/421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:11 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:11.797472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:11.798101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:11.804161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.804643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.805105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.805791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:11.806243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:11.806658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:11.943739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:11.952048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab3a1d4a-ae72-4d06-b44a-e56d09ca915f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.158441 Oct 03 16:02:11.952985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 223/422] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:11 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:12.492943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:12.494292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:12.502035 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.502771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.503388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.506378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.507057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.507648 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.554117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:12.555045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:12.562109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.562883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.563538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.564675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.565354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.565966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.733543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:12.742254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ff649d5-4569-401b-bfc7-68c315010369 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.253105 Oct 03 16:02:12.743418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 200/423] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:12 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:12.749706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:12.750557 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:12.756565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.757293 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.758085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.758939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.759546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.760990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.769954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:12.781968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:12.783771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:12.785143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d43702ce-95b1-407b-9a2b-770cdad79cea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.235188 Oct 03 16:02:12.785935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 224/424] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:12 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:12.906499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:12.915202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77908697-fbf7-46e3-8b37-e1491c9db1f3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.170495 Oct 03 16:02:12.915739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 201/425] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:12 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:12.975364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:12.975964 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:12.982697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.983175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.983604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:12.984283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:12.984744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:12.985400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.004264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "name": "network-vif-plugged", "status": "completed", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:13.019050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:13.019812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:13.020315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.032044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] Creating event network-vif-plugged:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:02:13.039769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-40d28bec-755e-47fb-b5c7-99553475aeed req-4b3041d3-cca1-431a-9e12-18066007042f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Oct 03 16:02:13.041086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 202/426] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:02:13.133037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:13.141553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-716fd419-84bb-44b4-b8cd-dd6f4e9ab481 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.169929 Oct 03 16:02:13.142846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 225/427] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:12 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:13.770034 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:13.771781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:13.781759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:13.782559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:13.783061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.783755 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:13.784536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:13.785054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.814286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:13.814897 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:13.821363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:13.821852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:13.822289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.823565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:13.824019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:13.824443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:13.992971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.002369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78860129-b3e7-4a32-8bde-19f90ab2dfa1 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.237106 Oct 03 16:02:14.003969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 203/428] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:13 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:14.008821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:14.009430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:14.017812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:14.018354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:14.018794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:14.019615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:14.020522 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:14.021012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:14.037882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.048365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.050278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.051885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7e4c652-f2e1-4d89-bf70-2460eeebdf69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.241380 Oct 03 16:02:14.052612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 226/429] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:13 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:14.163191 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.163613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:14.164218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:14.170452 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:14.170938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:14.171369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:14.172063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:14.172243 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a0dbb49-e361-4f29-942f-504215f2715f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.167119 Oct 03 16:02:14.172515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:14.172954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:14.176055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 204/430] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:14 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:14.311475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:14.319924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a00d6a87-a5b6-4600-82d3-d1c8f6e4f4fd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.160351 Oct 03 16:02:14.321886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 227/431] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:14 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:15.026403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:15.027491 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:15.035373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.035905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.036452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.037270 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.037837 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.038259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.059922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:15.079051 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:15.080400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:15.086994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.087577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.088140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.088953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.089475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.089967 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.253471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.264292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ec1ef6c-ed5b-41fd-b990-779db1ffaaf0 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.242256 Oct 03 16:02:15.265252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 205/432] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:15 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:15.284907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.295611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:15.296229 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:15.302061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.302621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.303186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.303512 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.303776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.304555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.304694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0edac653-c531-45e8-95db-a8632c768e47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.229575 Oct 03 16:02:15.305189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.305433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 228/433] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:15 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:15.306281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.345732 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:15.347012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:15.354346 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.355716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.356150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.357182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:15.357650 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:15.358074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:15.503651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.513100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d0730652-6feb-4163-8304-da0b2f272afe tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.231422 Oct 03 16:02:15.514019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 206/434] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:15 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:15.531413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:15.539913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ac3d4d1-dbf6-4239-8cd8-6dfef2841d1a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.197737 Oct 03 16:02:15.540401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 229/435] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:15 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:16.288214 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:16.288926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:16.295549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.296038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.296478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.297270 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.297704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.298131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.335240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:16.335838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:16.342516 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.343016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.343479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.344147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.344606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.345072 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.501073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.511749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e416a53-ffa1-415b-8422-3b04220b8475 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.227864 Oct 03 16:02:16.512869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 207/436] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:16 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:16.536282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:16.537195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:16.542369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.544806 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.545501 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.546112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.547005 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.547626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.548916 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.558514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.560544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.562089 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f58827e2-8061-44f4-a2e5-3ac9fd4e120d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.230733 Oct 03 16:02:16.563140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 230/437] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:16 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:16.568494 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:16.569219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:16.577109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.577673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.578172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.578956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:16.579470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:16.580213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:16.794813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.798219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:16.803317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16b9878e-51bd-44d6-92dc-fb0ace38b7d8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.238947 Oct 03 16:02:16.804192 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 231/438] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:16 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:16.807342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cc05e4d-e864-47f2-a708-845b0a00df1a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.274456 Oct 03 16:02:16.808543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 208/439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:16 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:17.535868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:17.536462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:17.542492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.542978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.543405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.544091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.544536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.544979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.590276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:17.592358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:17.599716 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.600551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.601263 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.602685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.603363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.604287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.726140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:17.729151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:17.737777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84d4c0ff-5eb0-4bc6-b87b-7d7a5f55c85e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.205708 Oct 03 16:02:17.738942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 232/440] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:17 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:17.783972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:17.794146 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:17.795693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:17.797003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0e606d0-93c2-468b-8a6e-dde0a39342c3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.211880 Oct 03 16:02:17.797739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 209/441] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:17 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:17.828457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:17.829099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:17.837035 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.837702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.838227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.839102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:17.839547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.839791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:17.840216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.841084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.846748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.847238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.847713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.848415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:17.848900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:17.849329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:17.860150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:18.053187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:18.059032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:18.061442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=16 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:18.066028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1b8494e-1a0a-40b8-b59b-ed067bb0cf6f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.240978 Oct 03 16:02:18.068427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c805c0e-aa6b-4868-940d-e714fefdf231 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.233306 Oct 03 16:02:18.069120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 210/442] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:17 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:18.082556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 233/443] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:17 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:18.762960 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:18.763604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:18.770434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:18.770924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:18.771362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:18.772073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:18.772528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:18.772984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:18.824383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:18.825027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:18.833804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:18.834294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:18.834726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:18.835433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:18.835890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:18.836320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:18.962999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:18.972435 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5845ef39-1c9f-4494-b659-f29e55d5e792 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.214388 Oct 03 16:02:18.973051 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 211/444] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:18 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:19.030129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:19.039033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:19.040494 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:19.051255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a53ba86-66f1-48ee-a005-320eef6fb344 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.222093 Oct 03 16:02:19.051255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 234/445] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:18 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:19.091856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:19.092502 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:19.099225 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:19.100025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:19.100603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:19.101490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:19.101797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:19.101954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:19.102376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:19.102487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:19.108655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:19.109179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:19.110011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:19.110825 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:19.111510 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:19.111932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:19.308307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:19.319094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a00d36ca-5698-43a0-ada9-6c588a349976 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.232585 Oct 03 16:02:19.319677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 212/446] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:19 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:19.334869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:19.344477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8384c677-3972-49a6-8460-9ce1b91892b4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.246149 Oct 03 16:02:19.345740 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 235/447] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:19 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:19.996079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:19.996690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:20.003818 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.004399 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.004878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.005582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.006037 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.006574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.069750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:20.070379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:20.077073 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.077558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.077992 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.078692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.079145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.079569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.174508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.183377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4cde40fb-e0c9-44ec-a6d1-d57dcc72fcea tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.191708 Oct 03 16:02:20.183873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 213/448] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:19 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:20.230518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.241818 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.243280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.245028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3a99259-09af-4753-850a-13feaef02938 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.179252 Oct 03 16:02:20.245592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 236/449] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:20 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:20.343164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:20.343854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:20.349819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.350320 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.350750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.351427 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.351879 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.352296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.370745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:20.371358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:20.377223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.377697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.378126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.378802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:20.379246 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:20.379658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:20.539895 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.565468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b023b19-389c-403b-9ec5-0b7a94c1cd03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.225893 Oct 03 16:02:20.579523 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 214/450] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:20 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:20.604238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:20.612592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2c686c7-ec2e-499f-8074-654ddf79e2f4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1277 microversion: 2.1 time: 0.246196 Oct 03 16:02:20.613389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 237/451] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:20 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:21.209261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:21.209918 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:21.220802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.221766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.222447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.223423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.224080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.224713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.274676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:21.277388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:21.288657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.291446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.293121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.293961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.294918 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.295448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.546212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.554625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73ef76a5-718a-4fe7-a8aa-f63534923de4 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.349732 Oct 03 16:02:21.555577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 215/452] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:21 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:21.560525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee7b689-24a1-4318-b643-8e02216f7dec", "tag": "fa8d71f0-ca65-4c21-97c5-b323a708ab7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:21.569829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.570636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.571230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.582731 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] Creating event network-changed:fa8d71f0-ca65-4c21-97c5-b323a708ab7e for instance 2ee7b689-24a1-4318-b643-8e02216f7dec on hv-cinder-84456 Oct 03 16:02:21.591120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0d518d3a-1a61-40d9-a01c-cc70b67e3f8a req-023c5f15-e83e-4b3b-8d39-9788c4df1cfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031500 Oct 03 16:02:21.591990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 216/453] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:21.597633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:21.598331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:21.605942 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.606432 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.606868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.607566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.608193 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.608814 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.632564 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.641790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.643253 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.644622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6e9e852-df2c-4fa7-a9db-5fcb406f2242 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.375141 Oct 03 16:02:21.645359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 238/454] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:21 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:21.650078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:21.651398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:21.657895 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.658579 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.659178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.660068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:21.660683 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:21.661286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:21.792179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.800043 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53d6491d-cab4-4564-94d6-047c8df52ae7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.206686 Oct 03 16:02:21.800697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 217/455] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:21 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:21.827164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:21.834800 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82aaae01-6cc9-4028-b547-74e62a1b1af2 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.188254 Oct 03 16:02:21.835361 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 239/456] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:21 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:22.579501 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:22.579501 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:22.586189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.586677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.587111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.587810 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.588262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.588800 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.670199 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:22.670802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:22.676788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.677487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.677915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.678596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.679040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.679636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.727536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:22.735878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ed7dddd-a132-4bf3-9f16-e4408da34a08 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1319 microversion: 2.1 time: 0.160990 Oct 03 16:02:22.736543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 218/457] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:22 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:22.813577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:22.822627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:22.822826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:22.823408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:22.824077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:22.825265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d319cadf-df73-4d8b-bfeb-9112bb08d0c2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.159516 Oct 03 16:02:22.825813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 240/458] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:22 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:22.829569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.829993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.830431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.831124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.831578 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.831999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.859549 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:22.860148 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:22.866138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.866611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.867038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:22.867719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:22.868165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:22.868585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:23.019364 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:23.029457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e6b00ac-79f5-4559-97db-5b787914ecb7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1371 microversion: 2.1 time: 0.210318 Oct 03 16:02:23.030220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 219/459] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:22 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:23.053545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:23.063547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e324a025-cf67-4179-8c03-557b00de175f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.207427 Oct 03 16:02:23.067632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 241/460] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:22 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:23.759531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:23.760936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:23.767347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:23.767826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:23.768258 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:23.768987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:23.769437 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:23.769853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:23.850556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:23.851170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:23.857523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:23.858002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:23.858438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:23.859125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:23.859574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:23.859995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:23.912107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:23.919811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f50759f-4abd-479f-a33e-e96303fb276a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1508 microversion: 2.1 time: 0.164219 Oct 03 16:02:23.920373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 220/461] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:23 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:24.000520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:24.009272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:24.011406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:24.012578 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e45eae4f-2b42-48d9-96a5-3f7fb7793246 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.166048 Oct 03 16:02:24.013169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 242/462] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:23 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:02:24.053467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:24.054074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:24.061192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.061665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.062098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.062775 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.063216 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.063629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.086374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:24.086977 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:24.094321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.095349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.096004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.098331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.099014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.099658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.296440 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:24.301257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:24.310584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d1c475e-a003-43fa-8c6e-cacba279e0ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.227897 Oct 03 16:02:24.311157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 243/463] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:24 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:24.312368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86689db2-7d0f-4b5c-9501-244a600d5f09 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1564 microversion: 2.1 time: 0.262490 Oct 03 16:02:24.320289 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 221/464] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:24 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:24.335414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:24.335900 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:24.343974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.344639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.345270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.346131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:24.346746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:24.347330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:24.436682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f20bf538-9053-447f-9b5c-bef69869872a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104950 Oct 03 16:02:24.437636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 244/465] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:02:24 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:25.044991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:25.046557 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:25.053940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:25.054628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:25.055161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:25.055978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:25.056711 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:25.057248 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:25.281623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:25.283907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:25.292533 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:25.294009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:25.295175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b917119-0d62-4d67-b3a2-71ef1b878f02 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.260435 Oct 03 16:02:25.295956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 222/466] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:25 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:25.333593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:25.334274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:25.341204 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:25.341821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:25.342254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:25.342949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:25.343541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:25.344026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:25.811845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:25.820996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:25.826542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3cf96d00-7f1b-4766-a0ff-b6b6db7ec8ee tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.496833 Oct 03 16:02:25.827447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 245/467] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:25 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:25.831366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:25.831839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:25.832260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:25.844041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] Creating event network-changed:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:02:25.849101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7850312f-d0fe-4d0d-9b22-d991aa818880 req-17994679-965c-42cd-bab3-e046414ba8fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031590 Oct 03 16:02:25.849866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 223/468] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:02:26.325792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:26.326399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:26.332913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:26.333405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:26.333837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:26.334543 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:26.335167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:26.335587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:26.477288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:26.487210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:26.488928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:26.490276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a81e4f4b-28a1-4178-a2b9-39f9d853cc7b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.170095 Oct 03 16:02:26.505445 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 246/469] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:26 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:26.853032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:26.854718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:26.862308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:26.862791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:26.863220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:26.863909 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:26.864374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:26.864795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:27.005325 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:27.021797 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-859a998c-ffeb-4fba-9a58-3e725837488f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.174406 Oct 03 16:02:27.022351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 224/470] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:26 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:27.516773 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:27.517485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:27.523518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:27.524005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:27.524465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:27.525203 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:27.525850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:27.526286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:27.662765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:27.671417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:27.672886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:27.674031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-541ddc33-c532-4b37-9435-ddf8bad62cde tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.161238 Oct 03 16:02:27.674579 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 247/471] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:27 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:28.046189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:28.046773 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:28.053260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:28.053736 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:28.054160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:28.054842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:28.055288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:28.055701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:28.189581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:28.197328 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d96ce313-6710-456f-b1ad-44d955b25e7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.154978 Oct 03 16:02:28.197893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 225/472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:28 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:28.702508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:28.703127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:28.709165 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:28.709639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:28.710063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:28.710777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:28.711223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:28.711636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:28.848069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:28.856708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:28.858181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:28.859342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-040506a4-2cca-43a8-b335-fabc1965b484 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.163296 Oct 03 16:02:28.859935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 248/473] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:28 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:29.220106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:29.220652 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:29.227203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:29.227683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:29.228698 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:29.229759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:29.230219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:29.230640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:29.366683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:29.374418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8002e435-6dbb-40df-beda-c62897f930b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.158286 Oct 03 16:02:29.374981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 226/474] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:29 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:29.890224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:29.890829 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:29.896799 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:29.897271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:29.897722 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:29.898397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:29.898847 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:29.899288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:30.030383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:30.038991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:30.040444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:30.041782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-332f0a2f-7ebe-48bf-b2dd-c629ca2de151 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.155499 Oct 03 16:02:30.042341 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 249/475] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:29 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:30.397980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:30.399657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:30.407887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:30.408367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:30.408827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:30.409746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:30.410199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:30.410615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:30.553717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:30.561392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2aaad446-6673-4f25-bc6f-5bbf26dece49 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.167369 Oct 03 16:02:30.561954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 227/476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:30 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:31.070134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:31.070738 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:31.077263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:31.077739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:31.078167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:31.078854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:31.079300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:31.079712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:31.095595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:31.215703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:31.224917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:31.226362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:31.227524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b63aec8-c218-4281-9eca-f87c7672b198 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.161383 Oct 03 16:02:31.228079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 250/477] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:31 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:31.584621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:31.585246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:31.593162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:31.593645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:31.594078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:31.594758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:31.595309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:31.596084 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:31.732341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:31.740418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-899efa7d-b587-4f4a-a332-1a8d134d2da4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.159679 Oct 03 16:02:31.741018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 228/478] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:31 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:32.264003 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:32.264553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:32.270583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:32.271077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:32.271508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:32.272190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:32.272646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:32.273120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:32.402981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:32.411686 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:32.413153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:32.414290 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46a97dec-5f59-412c-a3e9-ebdfefb273fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.155315 Oct 03 16:02:32.414844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 251/479] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:32 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:32.764025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:32.764633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:32.771459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:32.771937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:32.772356 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:32.773067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:32.773511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:32.773927 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:32.839710 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "name": "network-vif-plugged", "status": "completed", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:32.858440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:32.858968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:32.861585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:32.880220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] Creating event network-vif-plugged:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:02:32.886821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9ea6d187-32ce-4b5d-8285-2704a79f7286 req-4ec587c4-e2ec-437e-b20f-8332b92434e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051318 Oct 03 16:02:32.887417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 252/480] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:32.948511 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:32.956693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a34c9a9-e79a-48cd-a54c-f21e2fcc6721 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.197158 Oct 03 16:02:32.957319 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 229/481] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:32 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:33.441877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:33.442599 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:33.452375 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:33.453673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:33.454289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:33.455380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:33.456034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:33.456682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:33.595149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:33.603968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:33.605456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:33.606662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e28ef79-b1f6-4d07-a329-1afafe0d2b3b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.169867 Oct 03 16:02:33.607220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 253/482] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:33 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:33.983324 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:33.984107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:33.994765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:33.995245 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:33.995673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:33.996364 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:33.996847 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:33.997259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:34.129982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:34.137993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f85af404-a71f-49c8-b352-c1b83fe163ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.161359 Oct 03 16:02:34.138561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 230/483] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:33 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:34.632261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:34.632904 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:34.639759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:34.640245 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:34.640677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:34.641393 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:34.642033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:34.642467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:34.779518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:34.788462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:34.789966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:34.792331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29ed220f-d652-4bb5-9d56-ce54e4d981d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.164032 Oct 03 16:02:34.792917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 254/484] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:34 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:34.904882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee7b689-24a1-4318-b643-8e02216f7dec", "name": "network-vif-plugged", "status": "completed", "tag": "fa8d71f0-ca65-4c21-97c5-b323a708ab7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:34.914313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:34.914804 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:34.915226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:34.926492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] Creating event network-vif-plugged:fa8d71f0-ca65-4c21-97c5-b323a708ab7e for instance 2ee7b689-24a1-4318-b643-8e02216f7dec on hv-cinder-84456 Oct 03 16:02:34.933313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7298834a-71f5-41a2-8f1c-e138d40bf503 req-fc812ced-d0ed-4e69-b8f5-bbde2a80676d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Oct 03 16:02:34.933894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 231/485] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:35.160912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:35.161642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:35.169438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:35.169942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:35.170410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:35.171181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:35.171664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:35.172091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:35.309429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:35.318261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3afc8e5a-d308-496b-93cc-8cd26534ae2c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.162359 Oct 03 16:02:35.318830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 255/486] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:35 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:35.819099 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:35.819812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:35.827622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:35.828093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:35.828528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:35.829405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:35.829855 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:35.830271 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:35.963472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:35.972284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:35.973745 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:35.974917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7fbe6cf-219a-4a07-9be3-0c9d3df03384 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.160114 Oct 03 16:02:35.975465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 232/487] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:35 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:36.341862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:36.342714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:36.350619 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:36.351135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:36.351565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:36.352257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:36.353275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:36.353697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:36.498945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:36.507680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed4fd599-9b3c-4694-8715-c0066f0b69d7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1265 microversion: 2.1 time: 0.170536 Oct 03 16:02:36.508822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 256/488] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:36 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:37.001748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:37.002350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:37.009422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.009898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.010326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.011005 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.011455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.011871 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.150105 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:37.159792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:37.161264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:37.162416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57fb6d69-a6b6-47ca-b81e-006b662dd5d9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1808 microversion: 2.20 time: 0.164546 Oct 03 16:02:37.162972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 233/489] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:36 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:37.531528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:37.532073 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:37.537993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.538477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.538929 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.539611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.540059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.541130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.588930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:37.589423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:37.591639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:37.596946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.597428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.597860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.598550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.599003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.599421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.677240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:37.685488 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-326710de-f35a-4ac8-8582-0fb88c4bd25f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1451 microversion: 2.1 time: 0.157972 Oct 03 16:02:37.686451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 257/490] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:37 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:37.709089 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:37.709697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:37.716438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.716950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.717387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.718090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:37.718524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:37.718944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:37.741633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'services' on Instance uuid e7a24b8d-f733-4d00-8cbd-5f211f9ef68e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:02:37.852094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:37.860232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4dcc650e-ccb1-44ee-8187-cfc224aaf1e1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1451 microversion: 2.1 time: 0.154850 Oct 03 16:02:37.860825 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 258/491] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:37 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:37.863639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77224b35-5ab1-4ba9-8151-ce17fa7b1c8f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments/bc2d8994-b305-4823-8500-b600ad8d304c" status: 202 len: 0 microversion: 2.1 time: 0.279068 Oct 03 16:02:37.864214 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 234/492] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:02:37 2022] DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments/bc2d8994-b305-4823-8500-b600ad8d304c => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 16:02:38.188219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:38.189003 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:38.195738 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:38.196274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:38.197882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:38.198899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:38.199230 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:38.199654 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:38.425692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:38.435305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:38.436939 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:38.438118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2903cdc5-49f9-4660-96c4-2adb24a86d34 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1795 microversion: 2.20 time: 0.253911 Oct 03 16:02:38.438987 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 259/493] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:02:38 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1795 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:02:39.652072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee7b689-24a1-4318-b643-8e02216f7dec", "tag": "fa8d71f0-ca65-4c21-97c5-b323a708ab7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:39.662294 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:39.662757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:39.663176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:39.674779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] Creating event network-changed:fa8d71f0-ca65-4c21-97c5-b323a708ab7e for instance 2ee7b689-24a1-4318-b643-8e02216f7dec on hv-cinder-84456 Oct 03 16:02:39.679719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-86cf0596-6e31-4fb0-9d16-d001d28c9d28 req-aee60358-fd21-488f-9db8-94a322eadc30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032982 Oct 03 16:02:39.680319 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 235/494] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:40.057872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:40.064202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:40.064958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:40.065458 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:40.092053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 16:02:40.144624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57718d66-d8cf-4be4-bf84-da8c3fe049f0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action" status: 202 len: 0 microversion: 2.1 time: 0.090744 Oct 03 16:02:40.145263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 260/495] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:02:40 2022] POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:02:40.155171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:40.156044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:40.163128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:40.164147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:40.164568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:40.166110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:40.166738 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:40.167172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:40.329255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:40.339958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62a791d4-eb63-49e7-8b7b-82679f4911af tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.190128 Oct 03 16:02:40.347424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 236/496] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:40 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:41.365677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:41.366372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:41.369211 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=80 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:41.374759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:41.375236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:41.375670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:41.376351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:41.376831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:41.377255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:41.509705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:41.517430 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c05ed6cb-712f-46a3-ac90-70a46f4f9072 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.158103 Oct 03 16:02:41.517981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 261/497] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:41 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:42.402409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "358f2375-c919-473e-9a16-961232aaad77", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:42.405377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:42.411782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:42.412262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:42.412699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:42.413410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:42.413864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:42.414308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:42.541350 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:42.542254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:42.549849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:42.551144 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:42.551927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:42.552628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:42.553122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:42.553555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:42.675366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7423c738-208e-4c21-a621-a98c5eeca17e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "POST /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277366 Oct 03 16:02:42.676525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 237/498] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:02:42 2022] POST /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:02:42.689083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:42.700066 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1f11bb0-2403-4f96-8081-e16ae9a46392 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.163194 Oct 03 16:02:42.700675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 262/499] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:42 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:43.723290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:43.723981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:43.731569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:43.732047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:43.732507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:43.733217 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:43.733670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:43.734088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:43.872077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:43.879674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25a34216-a30c-4377-8009-232e2062527e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.160663 Oct 03 16:02:43.880227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 238/500] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:43 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:44.903323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:44.903936 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:44.909920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:44.910399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:44.910834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:44.911558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:44.912017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:44.912439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:45.044828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:45.054014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9bc39c47-a4c3-4e42-b14b-4bb824053738 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.154695 Oct 03 16:02:45.054684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 263/501] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:44 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:46.078227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:46.078835 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:46.085331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:46.085805 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:46.086230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:46.087633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:46.088078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:46.088490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:46.103411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:46.219947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:46.227761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f21c749c-296d-4876-8a72-1d362012c2b8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.153661 Oct 03 16:02:46.228322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 239/502] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:46 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:47.251231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:47.251824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:47.257819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:47.258302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:47.259656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:47.260051 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:47.260499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:47.260948 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:47.394634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:47.402608 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-751da641-38da-45a4-b11a-260b1b5b15b2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.155404 Oct 03 16:02:47.403385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 264/503] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:47 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:48.425642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:48.426255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:48.433788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:48.434278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:48.434710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:48.435394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:48.435849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:48.436268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:48.563573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:48.571274 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e781b591-254e-47d0-b26c-f23f32631b35 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.149410 Oct 03 16:02:48.571772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 240/504] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:48 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:49.594428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:49.594972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:49.601116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:49.601591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:49.602526 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:49.603224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:49.603663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:49.604080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:49.737548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:49.751126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-679e4545-0074-4952-a920-14a5c528428d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1677 microversion: 2.1 time: 0.160794 Oct 03 16:02:49.751705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 265/505] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:49 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:50.774487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:50.775120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:50.781692 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:50.782164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:50.782591 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:50.783269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:50.783713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:50.784415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:50.935684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:50.944977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8eb65b25-3086-4f74-a9c8-09b45d573c99 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1654 microversion: 2.1 time: 0.174209 Oct 03 16:02:50.945549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 241/506] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:50 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:50.975670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:02:50.983770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:50.984254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:50.984694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:51.014256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Going to try to start instance {{(pid=120587) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 16:02:51.017519 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:51.060882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d1ad604-8f09-4fa0-9488-e5053ef350c9 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action" status: 202 len: 0 microversion: 2.1 time: 0.089540 Oct 03 16:02:51.061500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 266/507] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:02:50 2022] POST /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:02:51.073634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:51.076824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:51.085791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:51.086234 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:51.087211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:51.088864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:51.089348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:51.089798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:51.242140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:51.251629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b0d247a-2a6c-43e4-a8fe-15e8a99243c0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1663 microversion: 2.1 time: 0.184456 Oct 03 16:02:51.252197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 242/508] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:51 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:52.275903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:52.276604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:52.282792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:52.283279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:52.283713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:52.284395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:52.284880 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:52.285305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:52.417690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:52.425501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49a1c9e7-a03d-4d9f-b293-c24961af4e51 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1663 microversion: 2.1 time: 0.154766 Oct 03 16:02:52.426058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 267/509] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:52 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:02:53.448549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:53.449216 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:53.455655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:53.456134 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:53.456568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:53.457290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:53.457739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:53.459147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:53.592055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:53.602122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d21ae8fe-30d3-4f88-8782-2362187ecf01 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1663 microversion: 2.1 time: 0.157336 Oct 03 16:02:53.603105 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 243/510] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:53 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:02:54.626707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:02:54.627327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:02:54.633282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:54.633761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:54.634193 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:54.634878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:02:54.635326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:02:54.635816 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:02:54.770147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:02:54.778534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d580af5-d5a6-461a-b366-dd17e1565551 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1667 microversion: 2.1 time: 0.155794 Oct 03 16:02:54.779100 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 268/511] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:02:54 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:06.410704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:06.411275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:06.414038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=19 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:06.415044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=27 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:06.420973 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:06.421455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:06.421885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:06.422660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:06.423114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:06.423534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:06.531830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'services' on Instance uuid 712d40fb-6814-434a-92d3-2fd4553169b1 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:06.606050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bef24aab-cddc-41e9-b69b-24a9c4e8efa8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "DELETE /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1/os-volume_attachments/358f2375-c919-473e-9a16-961232aaad77" status: 202 len: 0 microversion: 2.1 time: 0.199451 Oct 03 16:03:06.606685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 244/512] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:03:06 2022] DELETE /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1/os-volume_attachments/358f2375-c919-473e-9a16-961232aaad77 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:03:07.729117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:07.729603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:07.731918 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=15 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:07.732558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:07.738500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:07.738956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:07.739420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:07.740101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:07.740546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:07.740993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:07.767294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:03:07.849029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7f83f44-677a-4744-9c80-c63ea6925697 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "DELETE /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 204 len: 0 microversion: 2.1 time: 0.123553 Oct 03 16:03:07.849874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 269/513] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:03:07 2022] DELETE /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:03:07.860145 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:07.861826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:07.868660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:07.869202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:07.869638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:07.870331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:07.870784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:07.871208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:08.001905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:08.013228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4d814c4-5b8b-479a-804e-540de39df069 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1514 microversion: 2.1 time: 0.158946 Oct 03 16:03:08.013793 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 245/514] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:07 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:09.038385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:09.039629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:09.045681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:09.046168 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:09.046608 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:09.047300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:09.047758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:09.048187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:09.184405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:09.192186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bc8367a-9977-417a-9dab-3d7bc219ea7e tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1514 microversion: 2.1 time: 0.158112 Oct 03 16:03:09.192766 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 270/515] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:09 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:10.216116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:10.216750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:10.223060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:10.223529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:10.223951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:10.224630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:10.225170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:10.225581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:10.352057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:10.360406 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-041ebb7d-b0d0-4511-9f2d-4dee8a066e15 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1514 microversion: 2.1 time: 0.148381 Oct 03 16:03:10.361007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 246/516] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:10 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:10.933637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712d40fb-6814-434a-92d3-2fd4553169b1", "name": "network-vif-deleted", "tag": "29128e72-e7bc-47c7-9fae-fb89b598c55b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:10.946185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:10.947573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:10.948365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:10.962705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] Creating event network-vif-deleted:29128e72-e7bc-47c7-9fae-fb89b598c55b for instance 712d40fb-6814-434a-92d3-2fd4553169b1 on hv-cinder-84456 Oct 03 16:03:10.968303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d7003466-81fe-4da2-8874-54397ce002c8 req-0152b05b-64c3-414c-9a6d-be47227cdedd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038857 Oct 03 16:03:10.968906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 271/517] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:11.382535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:11.383091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:11.389852 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:11.390322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:11.390746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:11.391425 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:11.391868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:11.392280 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:11.423481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:11.423946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:11.424372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:11.424836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'fault' on Instance uuid 712d40fb-6814-434a-92d3-2fd4553169b1 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:11.464952 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:11.472784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14816cac-991c-42b9-b3de-69691e78a4f2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 200 len: 1309 microversion: 2.1 time: 0.094324 Oct 03 16:03:11.473338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 247/518] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:11 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:12.497668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:12.498369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 712d40fb-6814-434a-92d3-2fd4553169b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:12.504539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:12.505059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:12.505496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:12.506187 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:12.506646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:12.507069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:12.525048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] HTTP exception thrown: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Request method failure captured: Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 HTTP/1.1 Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwdrMoqwkQL4_r6L2GCdRp1lVxYIyFpnH8LYpFQgK6D3YpETIo_86is_5xjdHy6i56PjBbP9hQ50ObQLvp7sllyxghOna4oT20kiqnF2HgXxFTTW8ppOxnK4G-Uu4tidNxz1lwUP-yCRIIAqCnCppjoalPKtOY83fkXT2xsxX_y8lFs Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f8c41c14b0b3411d9b7e39e3983f2ccd Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:03:12.526758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8c41c14b0b3411d9b7e39e3983f2ccd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f8c41c14b0b3411d9b7e39e3983f2ccd Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotTestJSON-756409839-project Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 5d59791fcdee41149fce9b8a950963fc Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotTestJSON-756409839-project Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. Oct 03 16:03:12.528382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '712d40fb-6814-434a-92d3-2fd4553169b1'} Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:03:12.529207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. Oct 03 16:03:12.530404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:12.531535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Returning 404 to user: Instance 712d40fb-6814-434a-92d3-2fd4553169b1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:03:12.531535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd2b84c5-2f11-4f18-af38-b0a03148856a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1" status: 404 len: 111 microversion: 2.1 time: 0.034734 Oct 03 16:03:12.531535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 272/519] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:12 2022] GET /compute/v2.1/servers/712d40fb-6814-434a-92d3-2fd4553169b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:03:20.420147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1206403674", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "networks": [{"uuid": "2eb47dc5-6e8d-4486-b34c-6986a542da63"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:20.473329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] validate_networks() for [('2eb47dc5-6e8d-4486-b34c-6986a542da63', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:03:21.068671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:03:21.069125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:03:21.069634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:03:21.070190 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:03:21.070608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:03:21.079305 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:21.079813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:21.080243 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:21.081000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:21.081453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:21.081872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:21.099472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Getting quotas for project f8c41c14b0b3411d9b7e39e3983f2ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:03:21.104032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Getting quotas for user 5d59791fcdee41149fce9b8a950963fc and project f8c41c14b0b3411d9b7e39e3983f2ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:03:21.114890 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:03:21.117286 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:03:21.164603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d46897d5-e15f-4bf7-b0bc-d74fd23a9ce2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748175 Oct 03 16:03:21.165215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 248/520] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:03:21.176525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13acb8e8-f3a3-45be-815e-8ae7eeca353d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:21.177166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13acb8e8-f3a3-45be-815e-8ae7eeca353d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:21.237340 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-13acb8e8-f3a3-45be-815e-8ae7eeca353d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:21.245022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13acb8e8-f3a3-45be-815e-8ae7eeca353d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1219 microversion: 2.1 time: 0.072517 Oct 03 16:03:21.245582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 273/521] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:21 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:22.000900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eb7ffb9-ad3a-4735-8917-3c41ef654878"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:22.003352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:22.010247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:22.010728 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:22.011158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:22.011848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:22.012360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:22.012808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:22.268661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:22.269297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:22.275853 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:22.276330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:22.276779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:22.277465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:22.277932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:22.278335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:22.345643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:22.354966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29e48e30-5038-4444-b802-f1508eadf4a5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1271 microversion: 2.1 time: 0.090095 Oct 03 16:03:22.355482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 274/522] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:22 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:22.496516 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf33e7aa-2dc1-467c-b887-d9dfc8f34bcb tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499971 Oct 03 16:03:22.503132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 249/523] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:03:21 2022] POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:23.379488 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:23.380016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:23.386112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:23.386592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:23.387021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:23.387708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:23.388153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:23.388575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:23.520556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:23.528403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-542210d1-f683-4372-91c9-c073ae135ff8 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.152954 Oct 03 16:03:23.528998 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 275/524] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:23 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:23.998261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ff1918-7d0c-422f-a56b-75ce0ea903cb", "tag": "1e403651-934b-47dc-9807-9fec7b0415a4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:24.011689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.012584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.013207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.025893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] Creating event network-changed:1e403651-934b-47dc-9807-9fec7b0415a4 for instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb on hv-cinder-84456 Oct 03 16:03:24.030593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6e8efe89-95fa-4614-820a-d4843c5bd5da req-1d7428a1-181a-4e96-bda7-1ea5a34d493d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 Oct 03 16:03:24.031488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 250/525] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:24.552191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:24.552824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:24.559623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.560096 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.560524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.561232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.561680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.562099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.698764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:24.706426 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c11f3799-cd25-4782-bb81-5eea2eb1f3ed tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.158118 Oct 03 16:03:24.706975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 276/526] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:24 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:25.730848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:25.731634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:25.737961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:25.738516 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:25.739021 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:25.739780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:25.740396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:25.740847 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:25.881053 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:25.889421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f203b43-1678-486d-beb5-b8e873251bce tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.163724 Oct 03 16:03:25.889986 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 251/527] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:25 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:26.912595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:26.914070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:26.920035 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:26.920505 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:26.920970 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:26.921644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:26.922088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:26.922507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:27.058221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:27.065945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e4ac34a-70a3-4e7b-bdcd-ed1d47f620bd tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.157253 Oct 03 16:03:27.066507 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 277/528] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:26 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:28.088592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:28.089197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:28.095821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:28.096296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:28.096741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:28.097426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:28.097873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:28.098294 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:28.229707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:28.238933 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d01d760f-47be-4828-bb5b-6a71df45b043 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.154749 Oct 03 16:03:28.239495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 252/529] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:28 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:29.263193 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:29.263928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:29.270295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:29.270777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:29.271201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:29.271910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:29.272392 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:29.273056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:29.411655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:29.419939 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22a699ad-4c0d-4d66-8316-0a9f01a1b00c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.162008 Oct 03 16:03:29.420501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 278/530] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:29 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:30.061015 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:30.063299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:30.070097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.070582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.071017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.071706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.072165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.072587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.095770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'flavor' on Instance uuid a5fb7e1a-6583-4305-b5aa-5c6c29643641 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:30.220166 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-508bbd0f-ffb9-4e6c-9ce1-5a96cd0b5c61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/action" status: 200 len: 32 microversion: 2.1 time: 0.162995 Oct 03 16:03:30.220687 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 253/531] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:03:30 2022] POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:03:30.231476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:30.232112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:30.238352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.238954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.239582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.240366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.240966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.242147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.378584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:30.387317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c42e3b6d-1a55-4a0f-ad76-a242575d0d3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.160768 Oct 03 16:03:30.387878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 279/532] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:30 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:30.444662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:30.445385 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:30.451892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.452382 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.452846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.453547 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.454002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.454426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.590536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:30.598290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e47c03fb-b22a-47de-9e35-35ff0ab48bfa tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.158492 Oct 03 16:03:30.598856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 254/533] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:30 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:31.007294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ff1918-7d0c-422f-a56b-75ce0ea903cb", "name": "network-vif-plugged", "status": "completed", "tag": "1e403651-934b-47dc-9807-9fec7b0415a4"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:31.017151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.017633 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.018092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.030206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] Creating event network-vif-plugged:1e403651-934b-47dc-9807-9fec7b0415a4 for instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb on hv-cinder-84456 Oct 03 16:03:31.035085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1df28c6b-afb4-4f68-bb5c-a71d086b1095 req-2b45d792-3adc-43b0-85e6-b45e08861e96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031794 Oct 03 16:03:31.035885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 280/534] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:31.411199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:31.411809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:31.414983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:31.415626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:31.422345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.422819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.423247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.423925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.424395 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.424839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.557072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:31.565279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81a75b6c-1b4f-41ac-af5e-43314b763884 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.158022 Oct 03 16:03:31.565841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 255/535] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:31 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:31.618579 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:31.622775 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:31.623487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:31.629796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.630265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.630687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.631948 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.632466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.632915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.761053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:31.769670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2535819c-b8b9-4179-aaa3-c7ffd562d7b5 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.152075 Oct 03 16:03:31.770233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 281/536] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:31 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:32.589085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:32.589882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:32.596386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.596901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.597343 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.598030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.598480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.598903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.726103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:32.734229 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7c2962a-6fb3-4cf1-b247-70504f901746 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.149698 Oct 03 16:03:32.734808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 256/537] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:32 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:32.792647 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:32.793283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:32.799282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.799764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.800222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.801418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.802247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.803012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.937901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:32.946632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-855bea8d-be0a-4df1-950d-9ef9def6cc55 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1319 microversion: 2.1 time: 0.157799 Oct 03 16:03:32.947315 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 282/538] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:32 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:33.758244 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:33.758783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:33.765189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.765660 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.766087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.766762 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.767204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.767617 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.788481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:33.815546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:33.816109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:33.822228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.822808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.823241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.823937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.824387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.824937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.858797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25af8174-718d-4bd7-a97e-5183f3f9830a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments/0319a5e7-4105-4260-912d-1dd268a8e313" status: 200 len: 194 microversion: 2.20 time: 0.047125 Oct 03 16:03:33.859409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 283/539] 10.222.0.33 () {60 vars in 1454 bytes} [Mon Oct 3 16:03:33 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments/0319a5e7-4105-4260-912d-1dd268a8e313 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 16:03:33.903475 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:33.912025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-caae6ab2-cde4-4149-9255-22442b3161cd tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.157742 Oct 03 16:03:33.912686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 257/540] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:33 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:33.929472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:33.930029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:33.935902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.936379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.936911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.937595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.938047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.938471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.970628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:33.971239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:33.977159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.977639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.978073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.978765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.979218 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.979641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.062518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lazy-loading 'services' on Instance uuid c36b3edc-789f-4598-973a-889f9678a395 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:34.118808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:34.126665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aacfe6ed-b920-4b07-9b3b-12fc404daf9a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1509 microversion: 2.1 time: 0.159964 Oct 03 16:03:34.127237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 258/541] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:33 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:34.150116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d4cffa-2bf2-4886-bf47-ec3018aa16d5", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:34.152584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:34.158524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.158966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.159405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.160161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.160595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.161094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.181241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7be4585-a1db-41f3-8f7a-a233617649cf tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments/0319a5e7-4105-4260-912d-1dd268a8e313" status: 202 len: 0 microversion: 2.20 time: 0.255685 Oct 03 16:03:34.182048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 284/542] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Oct 3 16:03:33 2022] DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments/0319a5e7-4105-4260-912d-1dd268a8e313 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:03:34.190566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:34.193214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:34.200638 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.201254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.201758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.202527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.203118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.203541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.236704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11f21af4-d230-487a-b88b-b51c8ce780cc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050216 Oct 03 16:03:34.237349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 285/543] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 16:03:34 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 16:03:34.406796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a826ca49-b45b-43a1-b921-18fe25332217 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "POST /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261117 Oct 03 16:03:34.407475 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 259/544] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:03:34 2022] POST /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:03:34.934828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:34.935458 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:34.941431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.941909 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.942344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.943025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:34.943473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:34.944090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.948064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:35.077667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:35.087901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5668886-9512-49d8-ab96-8c78ba573068 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.156870 Oct 03 16:03:35.088688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 286/545] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:34 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:35.251503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:35.253911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:35.260853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.261335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.261780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.262467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.262949 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.263372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.294015 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9876c45a-6b37-4190-b0bf-521a1982e901 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047298 Oct 03 16:03:35.294569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 260/546] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 16:03:35 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:35.361135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:35.361641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:35.368159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.368583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.369042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.369722 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.370167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.370582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.395826 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:03:35.477191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efa97c30-9cc4-4543-b2c1-b3f87902f780 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 204 len: 0 microversion: 2.20 time: 0.119488 Oct 03 16:03:35.478606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 287/547] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 16:03:35 2022] DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 16:03:35.489870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:35.490513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:35.497529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.498008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.498439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.499124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.499563 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.500203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.634473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:35.642681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:35.644139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:35.645330 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b0a8073-90b1-46e1-900a-c3c8da346367 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.159340 Oct 03 16:03:35.645978 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 261/548] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:35 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:36.112938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:36.113627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:36.119630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.120095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.120517 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.121219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.121660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.122081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.251710 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:36.260654 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-228b8375-f583-40fa-b72f-305aa270a6d1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.152057 Oct 03 16:03:36.261244 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 288/549] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:36 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:36.671160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:36.671708 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:36.674163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:36.679853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.680327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.680789 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.681473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.681923 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.682344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.810451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:36.818533 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:36.820623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:36.821792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b94d47f5-fd2d-44af-9d54-95ba2bddbcce tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1723 microversion: 2.20 time: 0.154557 Oct 03 16:03:36.822340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 262/550] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:36 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:37.283999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:37.284602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:37.292166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.292656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.293135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.293822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.294272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.294698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.448219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:37.459965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a64b5f85-007e-4c1f-8649-a53b48b77802 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.179364 Oct 03 16:03:37.462668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 289/551] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:37 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:37.846951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:37.847663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:37.855394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.855864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.856314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.857020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.857466 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.857903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.922793 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:37.932041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:37.933517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:37.934671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1a54f3c-806a-419c-a492-b40d29665bba tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1655 microversion: 2.20 time: 0.091791 Oct 03 16:03:37.935264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 263/552] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:37 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:38.213251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b3edc-789f-4598-973a-889f9678a395", "name": "network-vif-deleted", "tag": "279a065d-37a6-41d4-b55c-f869f78cf9cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:38.221513 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:38.227097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.228056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.228056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.245096 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] Creating event network-vif-deleted:279a065d-37a6-41d4-b55c-f869f78cf9cc for instance c36b3edc-789f-4598-973a-889f9678a395 on hv-cinder-84456 Oct 03 16:03:38.251644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d4c77531-7d17-4f12-a47e-5899c1b9fc77 req-5b398ebf-5097-4dea-adf4-a85784658a22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042500 Oct 03 16:03:38.252249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 290/553] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:38.493958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:38.494564 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:38.500643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.501150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.501643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.502259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.502702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.503130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.642662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:38.651419 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd3166cc-317c-4925-8580-d28511cb4499 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.161236 Oct 03 16:03:38.651988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 264/554] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:38 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:38.836492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:38.838741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:38.845275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.845744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.846183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.846895 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.847344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.847764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.879569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ae510f8-9f6d-48c0-849b-5ad4b261c321 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047860 Oct 03 16:03:38.880160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 291/555] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:03:38 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:03:38.951576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:38.952097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:38.961404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:38.962432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:38.971702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.973459 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.974137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.974575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.975587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.976148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.976576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.979181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.979626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.980336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.980817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.981229 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.016110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:03:39.025660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:39.026247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:39.026988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.029118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lazy-loading 'fault' on Instance uuid c36b3edc-789f-4598-973a-889f9678a395 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:39.094693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:39.107171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:39.108644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:39.109795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-979706e9-1669-4ccc-9bf7-a3f0553de765 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 200 len: 1372 microversion: 2.20 time: 0.153403 Oct 03 16:03:39.110886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 292/556] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:38 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:39.137619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4f2df14-790b-484a-bff2-000bcce575ee tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 204 len: 0 microversion: 2.1 time: 0.188792 Oct 03 16:03:39.140801 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 265/557] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:03:38 2022] DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:03:39.147697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:39.148548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:39.154955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:39.155443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:39.155892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.156668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:39.157150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:39.157910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.297774 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:39.307239 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08a4c2fa-8736-4660-a060-bae45aacbae7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1673 microversion: 2.1 time: 0.164290 Oct 03 16:03:39.307811 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 293/558] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:39 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:39.675672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:39.676360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:39.683082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:39.683553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:39.683977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.684656 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:39.685127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:39.685540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:39.817284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:39.826169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-501bf27b-9c9a-4b7d-b3e5-9e0ff8f59f1c tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.154756 Oct 03 16:03:39.826735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 266/559] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:39 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:40.136460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:40.137208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.143597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.144083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.144518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.145245 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.145695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.146113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.160370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 HTTP/1.1 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:03:40.162048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:03:40.164365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'c36b3edc-789f-4598-973a-889f9678a395'} Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:03:40.165238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:03:40.166454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:40.167514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:03:40.167514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3375212a-7aaa-4317-8954-b2cdf861868a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 404 len: 111 microversion: 2.20 time: 0.031956 Oct 03 16:03:40.167514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 294/560] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:40 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:03:40.173595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b42d01a-ff3b-4257-88d1-94564a60b1f0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '.version_select at 0x7f8174bf3e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:40.194395 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b42d01a-ff3b-4257-88d1-94564a60b1f0 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532459905" status: 204 len: 0 microversion: 2.20 time: 0.024488 Oct 03 16:03:40.194952 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 267/561] 10.222.0.33 () {60 vars in 1262 bytes} [Mon Oct 3 16:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532459905 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 16:03:40.333973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:40.335695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.344294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.344807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.345247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.346270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.346401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.346822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.620477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:40.628562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-358a235e-7d6c-4c1d-964a-332e42c4ce27 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1673 microversion: 2.1 time: 0.298878 Oct 03 16:03:40.629160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 295/562] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:40 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1673 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:40.850301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:40.850956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.857618 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.858323 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.858770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.859471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.859987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.860414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.899215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ac62833-c41e-4726-9acc-82f67dd16fed tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: .version_select at 0x7f8175a27670>, body: {"keypair": {"name": "tempest-keypair-51833190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIHd7W8sEgtUo4ewmFnGfpPCWp13IRKYxHD6vZ5grkNXojK2nDd9CS83USxJGtMU/f8MbmLx44ZUrBIXKwbJBZZzxN7056EBur0XkiWL/4DLTs4/pTchlzhq3celQV1gg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:40.916226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-1ac62833-c41e-4726-9acc-82f67dd16fed tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:03:40.920624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-1ac62833-c41e-4726-9acc-82f67dd16fed tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for user 5e113c9ec968460ba070cfc1a69a25a1 and project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:03:40.946444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ac62833-c41e-4726-9acc-82f67dd16fed tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.051689 Oct 03 16:03:40.947043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 296/563] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Oct 3 16:03:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 16:03:41.042602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:41.051418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4baeeda8-7c2f-455b-950a-9c97f6a68550 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.205609 Oct 03 16:03:41.052003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 268/564] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:40 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:41.653592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:41.654137 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:41.660294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:41.660829 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:41.661256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:41.661933 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:41.662643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:41.663066 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:41.831896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:41.840668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbf602dc-699f-456a-9371-4ea9ea74d349 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1673 microversion: 2.1 time: 0.191130 Oct 03 16:03:41.841252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 297/565] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:41 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:42.078332 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:42.079033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:42.086473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.086975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.087403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.088121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.088576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.089019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.278160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:42.286416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1aed64d2-c4dc-4cb8-a38b-9df1698f9967 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.211965 Oct 03 16:03:42.286991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 269/566] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:42 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:42.307597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-687407863", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90c6b009-4013-4301-b819-4e12c2de8610"}], "security_groups": [{"name": "tempest-securitygroup--6937161"}], "key_name": "tempest-keypair-51833190", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:42.417019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] validate_networks() for [('90c6b009-4013-4301-b819-4e12c2de8610', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:03:42.470212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:42.470654 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:42.476859 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.477453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.477980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.478733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.479245 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.479726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.503189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lazy-loading 'flavor' on Instance uuid ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:42.554348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:42.582353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6758d2f7-55f1-4a4d-bf14-d014874313ab tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "POST /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb/action" status: 202 len: 0 microversion: 2.1 time: 0.115944 Oct 03 16:03:42.586178 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 270/567] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:03:42 2022] POST /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 16:03:42.591888 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:42.592579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:42.598669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.599146 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.599584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.600269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.600733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.601176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.843197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:42.853878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0187448d-8365-4d73-9873-2fe53510ccbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.266226 Oct 03 16:03:42.859655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 271/568] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:42 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:42.873369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:42.874434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:42.883610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.884515 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.885776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.886295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.886787 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.903854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:03:42.904353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:03:42.904826 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:03:42.905460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:03:42.906081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:03:42.923133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.923620 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.924051 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.924788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.925236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.925653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.955060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:03:42.963695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Getting quotas for user 5e113c9ec968460ba070cfc1a69a25a1 and project d7ee0d51f58e4abd8867c54458f504fc. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:03:42.977580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:03:42.979922 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:03:43.032432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14e3fc41-35ce-488a-894e-8c1b09302588 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.729234 Oct 03 16:03:43.040168 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 298/569] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Oct 3 16:03:42 2022] POST /compute/v2.1/servers => generated 399 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 16:03:43.046105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:43.046708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:43.086544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:43.095364 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1014d779-86a2-43c3-b13d-f6e440b5ada8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1673 microversion: 2.1 time: 0.234123 Oct 03 16:03:43.096384 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 272/570] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:42 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:43.123154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:43.133909 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:43.135554 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:43.136921 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed2aae72-6ec1-42f0-81d6-99c2a6dc7ca8 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1279 microversion: 2.20 time: 0.095259 Oct 03 16:03:43.144989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 299/571] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:43 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:03:43.310082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:43.310977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:43.324201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:43.324741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:43.325472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:43.326113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:43.326778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:43.327873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:43.485394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:43.497048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4957198e-ff5b-41d4-b45d-1fbbbb19fb88 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.190713 Oct 03 16:03:43.516008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 273/572] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:43 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:43.613866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a24b8d-f733-4d00-8cbd-5f211f9ef68e", "name": "network-vif-deleted", "tag": "d710284d-cf34-4ba0-b620-3fcbf1bcd02b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:43.625219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:43.625835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:43.626790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:43.645322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] Creating event network-vif-deleted:d710284d-cf34-4ba0-b620-3fcbf1bcd02b for instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e on hv-cinder-84456 Oct 03 16:03:43.655421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-29d5441c-0b66-460c-91f8-ede9cc10f4de req-319b4939-f675-40da-a6e7-9156748bab93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045332 Oct 03 16:03:43.656707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 300/573] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:43.885456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:43.886161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:43.892048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:43.892597 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:43.893125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:43.893946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:43.894412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:43.894896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.045559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.054116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f806c08-4f65-4def-91a7-e97a1b60f5b2 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.173246 Oct 03 16:03:44.054691 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 274/574] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:43 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:44.123335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:44.124153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:44.135142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.136336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.136821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.138677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.139196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.139632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.162734 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:44.163995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:44.170929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.171779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.172413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.173338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.173984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.174596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.211234 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.226716 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.227376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.227856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid e7a24b8d-f733-4d00-8cbd-5f211f9ef68e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:44.277361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.290765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.292753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.294072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b892067a-0f20-4fe7-8ec5-7fc22f4f3ce5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1331 microversion: 2.20 time: 0.135553 Oct 03 16:03:44.294776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 275/575] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:44 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:03:44.316585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.325532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ede64f74-d94f-4e00-9618-65a07d3dc47d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1327 microversion: 2.1 time: 0.208649 Oct 03 16:03:44.329173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 301/576] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:44 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1327 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:44.524299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:44.524954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:44.531045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.531531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.531966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.532663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.533274 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.533701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.678300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.687042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24867302-9a40-4ea3-9068-faa84fb7cd55 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.167804 Oct 03 16:03:44.687604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 276/577] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:44 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:45.081363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:45.082016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:45.088194 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.088666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.089429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.090112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.090565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.090986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.220323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.228698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bcc8e7b-9114-4b17-a1d3-4be8f75ba170 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.152749 Oct 03 16:03:45.229288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 302/578] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:45 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:45.320297 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:45.320673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:45.327052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.327527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.327960 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.328635 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.329104 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.329523 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.351804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:45.352405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:45.358291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.358766 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.359188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.359862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.360308 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.360742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.392061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.392544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.392999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.393439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid e7a24b8d-f733-4d00-8cbd-5f211f9ef68e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:45.393852 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.402591 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.404040 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.405176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f4bb090-467c-47d3-8056-175b77a37369 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1331 microversion: 2.20 time: 0.089212 Oct 03 16:03:45.405741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 277/579] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:45 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1331 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:45.439201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.446966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-404d903d-809e-4607-987d-5f3b4e354258 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1327 microversion: 2.1 time: 0.099730 Oct 03 16:03:45.447520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 303/580] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:45 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:45.711131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:45.711655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:45.718123 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.718599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.719028 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.719703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.720148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.720566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.846091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.854931 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9968cdf5-bf35-4e2d-93ee-651c7b0a3042 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.148401 Oct 03 16:03:45.855497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 278/581] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:45 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:46.253136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:46.253736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:46.260386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.260898 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.261327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.262000 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.262445 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.262858 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.397664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.401151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:46.406207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc6715db-8651-407f-9999-58e893b928f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.156922 Oct 03 16:03:46.406767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 304/582] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:46 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:46.431943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:46.432561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:46.439050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.439535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.440055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.440764 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.441220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.441644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.470874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:46.471475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:46.478536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.479023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.479453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.480142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.480588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.481029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.506596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.514259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.514759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.515211 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.515631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid e7a24b8d-f733-4d00-8cbd-5f211f9ef68e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:46.516151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.517815 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.518925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7c6d27a-258d-468a-9e3c-a4bbdff6bb47 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1331 microversion: 2.20 time: 0.091440 Oct 03 16:03:46.519484 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 279/583] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:46 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:46.566977 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.575272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1fa0febe-6678-4fb3-bd23-800e727dbbea tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1327 microversion: 2.1 time: 0.108902 Oct 03 16:03:46.575837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 305/584] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:46 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:46.877463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:46.878065 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:46.884748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.885212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.885641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.886317 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.886763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.887181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.013374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.022121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-502fae54-b88d-48d8-b752-e136c9542d81 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1734 microversion: 2.1 time: 0.147911 Oct 03 16:03:47.022773 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 280/585] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:46 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:47.430821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:47.431454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:47.437418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.437892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.438319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.439002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.439580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.440032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.544377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:47.545039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:47.551472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.552041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.553523 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.554388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.554858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.555287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.575180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.584861 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c11007a-60e1-4caa-81d3-b261bf744fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.159044 Oct 03 16:03:47.602195 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 306/586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:47 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:47.608371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:47.609022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:47.617143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.617635 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.618075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.618771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.619220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.619641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.629476 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.638941 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.640388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.641576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0c570e7-fef2-4dd7-9801-422c0bfcfbf4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1331 microversion: 2.20 time: 0.101076 Oct 03 16:03:47.642313 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 281/587] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:47 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:03:47.657892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.658376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.659023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.659760 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid e7a24b8d-f733-4d00-8cbd-5f211f9ef68e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:47.703706 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.711931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47104c6b-45de-46bb-99a0-9c7bcaf289c8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 200 len: 1327 microversion: 2.1 time: 0.108631 Oct 03 16:03:47.712485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 307/588] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:47 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:48.045205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.045749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.052897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.053683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.054256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.054974 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.055707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.056380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.220575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.229977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-777baa91-e489-4a64-9dd5-b1f717a93292 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1714 microversion: 2.1 time: 0.188818 Oct 03 16:03:48.230542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 282/589] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1714 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:48.369685 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.370171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.376011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.376512 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.376979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.377652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.378185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.378604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.471804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] HTTP exception thrown: Cannot 'detach_volume' instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 while it is in vm_state rescued Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Request method failure captured: Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments/2eb7ffb9-ad3a-4735-8917-3c41ef654878 HTTP/1.1 Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbVZaQBQ2APGHTbpDb8MfEnlC_Hu8J1x4rJLy299mha70Q2e7JP4CM2b9nqMz9n5mWCa8mXe4MTXeIh-s5fjaSy9lCgAUJm6GQcdTUwwCgEqTW1aVX6MoTHYyTpP_TipQYNbeaQAwwdyqMVcUtOBg5lSip8LwroudXuhkI4Y9cUNrk Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:03:48.473435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2ed0fa1c2fe47a485c26522b2e81b8b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: b3098a7103d94b29bc4bce30cfd05bc6 Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:03:48.475111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Cannot 'detach_volume' instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 while it is in vm_state rescued Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'server_id': 'a5fb7e1a-6583-4305-b5aa-5c6c29643641', 'id': '2eb7ffb9-ad3a-4735-8917-3c41ef654878'} Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:03:48.475787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 while it is in vm_state rescued Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 while it is in vm_state rescued Oct 03 16:03:48.477031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.478965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Returning 409 to user: Cannot 'detach_volume' instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 while it is in vm_state rescued {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:03:48.479890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e17f1938-bdc0-410f-9583-15340afa8adc tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments/2eb7ffb9-ad3a-4735-8917-3c41ef654878" status: 409 len: 152 microversion: 2.1 time: 0.114432 Oct 03 16:03:48.480532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 308/590] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:03:48 2022] DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments/2eb7ffb9-ad3a-4735-8917-3c41ef654878 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 16:03:48.491246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:48.492769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.499241 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.500060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.500552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.501315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.501778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.502203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.592438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f543688-2698-42c8-9afd-e1c1d851edd1 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/action" status: 202 len: 0 microversion: 2.1 time: 0.105584 Oct 03 16:03:48.593570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 283/591] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:03:48 2022] POST /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:03:48.601642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.602272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.609609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.610141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.610581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.611287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.611750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.612097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.612248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.613121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.620460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.620977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.621465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.622598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.622598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.622988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.866224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.877518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1658358-6817-44c5-a28b-1900e24d6126 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1722 microversion: 2.1 time: 0.279340 Oct 03 16:03:48.878586 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 309/592] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:48.884996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.886029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.893261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.893747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.894367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.895252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.895883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.896358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.904112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.912712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-978eeab4-66d8-4d81-8477-0143ac346c64 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.305167 Oct 03 16:03:48.913977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 284/593] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:48.929176 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.930092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.936685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.937231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.937664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.938478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.938927 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.939341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.954596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e HTTP/1.1 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:03:48.958813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:03:48.960426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'e7a24b8d-f733-4d00-8cbd-5f211f9ef68e'} Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:03:48.961536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:03:48.963714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:03:48.965152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:03:48.965152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d445fb4f-f66c-4d12-a230-cace844c2555 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 404 len: 111 microversion: 2.1 time: 0.046212 Oct 03 16:03:48.965152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 285/594] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:03:48.970937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8d1f732-09ad-4cba-885f-62ca6a8f3abd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '.version_select at 0x7f8174bf3c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.978148 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.986783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.988644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:48.989760 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1e0ea30-f12f-4437-aba7-25b0c291f9e2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1337 microversion: 2.20 time: 0.109483 Oct 03 16:03:48.990931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 310/595] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:48.992651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8d1f732-09ad-4cba-885f-62ca6a8f3abd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810370027" status: 202 len: 0 microversion: 2.1 time: 0.025431 Oct 03 16:03:48.993683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 286/596] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:03:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810370027 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 16:03:49.616901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d55043b-083c-4494-af4d-b9602ea16ef6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: .version_select at 0x7f81785adf70>, body: {"keypair": {"name": "tempest-keypair-1744475952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0fzPCRa+qMtDEtD+DO9UxM9H1BgYUY2wBQLZ5WQhX/dgq42NhD12JtODfKItF1KbXyAFwadYANwMF3eGurnkkXUUw+mKq4GfjFmzaG9cdMsrbuF759lN/Z2M0VBENJGQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:49.632474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-8d55043b-083c-4494-af4d-b9602ea16ef6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:03:49.636274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-8d55043b-083c-4494-af4d-b9602ea16ef6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for user 73a1aa0996db4c8ea851b2ba45026b35 and project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:03:49.657780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d55043b-083c-4494-af4d-b9602ea16ef6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045408 Oct 03 16:03:49.658367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 311/597] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:03:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:49.903737 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:49.904493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:49.912210 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:49.912905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:49.913414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:49.914183 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:49.914833 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:49.915259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:49.936271 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:49.938347 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:49.938968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:49.946008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:49.946595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:49.947282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:49.948272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:49.948957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:49.949385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:50.371557 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.380368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.380594 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1c922ad-f3b3-463b-947c-243eb26f41a2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1722 microversion: 2.1 time: 0.480697 Oct 03 16:03:50.381106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 287/598] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:49 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:50.392997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dda37609-0ad0-4db6-b5b2-a2be228accd7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.454729 Oct 03 16:03:50.392997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 312/599] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:49 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:50.397319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:50.397916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:50.403924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:50.404398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:50.405083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:50.405779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:50.406232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:50.406653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:50.540662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.549022 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.550480 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.551584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32d71f37-bcc4-4ba8-ae8d-30c0983420a9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.161326 Oct 03 16:03:50.552134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 313/600] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:50 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:50.988975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1914841065", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b631aad-5777-4efa-a0a0-1b5b5e7e2d32"}], "security_groups": [{"name": "tempest-securitygroup--98253920"}], "key_name": "tempest-keypair-1744475952", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:51.091314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] validate_networks() for [('1b631aad-5777-4efa-a0a0-1b5b5e7e2d32', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:03:51.404857 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:51.405537 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:51.411520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.413076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.413516 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.414215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.414665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.415084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.548341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:03:51.549017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:03:51.549651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:03:51.550259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:03:51.550834 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:03:51.561610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.562359 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.562959 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.563848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.564486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.564947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.593569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:03:51.600184 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Getting quotas for user 73a1aa0996db4c8ea851b2ba45026b35 and project a8db1f811cf84507ad7ea7058d6a0d25. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:03:51.613669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:03:51.617071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:03:51.696495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7387302-9967-4d0a-80f1-2dc5811126a0 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.711759 Oct 03 16:03:51.697841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 288/601] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:03:50 2022] POST /compute/v2.1/servers => generated 400 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:03:51.698209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:51.702541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:51.703171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:51.711390 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7dadd7fb-5e74-4875-9f2d-e16f086f16c8 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1722 microversion: 2.1 time: 0.310407 Oct 03 16:03:51.712201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 314/602] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:51 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:51.716520 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.717043 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.717476 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.718170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.718623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.719037 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.732588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:51.733342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:51.750202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.750698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.751126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.751831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.752294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.752712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.073521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.084411 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.085312 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df0d0053-da3b-46c6-92b3-5825f88f48e8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.386462 Oct 03 16:03:52.086396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 289/603] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:51 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:52.093191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.094506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e591cb6c-3cbe-4e07-ad72-73a49bbc8f5b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:52.095225 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e591cb6c-3cbe-4e07-ad72-73a49bbc8f5b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:52.095584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.096901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f8f9bc9-2b2d-446a-9f4e-4a0aa75eb92d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.371032 Oct 03 16:03:52.110433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 315/604] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:51 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:52.226558 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e591cb6c-3cbe-4e07-ad72-73a49bbc8f5b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.236179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e591cb6c-3cbe-4e07-ad72-73a49bbc8f5b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1238 microversion: 2.1 time: 0.148263 Oct 03 16:03:52.237220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 290/605] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:52 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:52.331320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:52.344049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:52.347133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:52.347590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:52.348205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.377790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] Creating event network-changed:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:03:52.385358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-26134bd6-70aa-41c8-b98c-38dacd695451 req-11cab21a-b7b1-42a5-96c1-8cf2b1adfc53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058578 Oct 03 16:03:52.386228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 316/606] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:03:52.735784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:52.736477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:52.744147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:52.744639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:52.745128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.745817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:52.746278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:52.746705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.915615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.923975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c3e8ae3-c99f-4d41-bdd4-8d5693712efa tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1722 microversion: 2.1 time: 0.192148 Oct 03 16:03:52.924555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 291/607] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:52 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:53.113101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:53.118591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:53.119291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:53.125765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:53.126351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.126554 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:53.126851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.127288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.127994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.128450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.128916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.134732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.135320 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.135760 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.136494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.136985 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.137404 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.340201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.346953 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.348129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-509326bd-90bb-4414-a5c1-b7a8f17177f8 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.236532 Oct 03 16:03:53.361538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 317/608] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:53 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:53.361538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:53.361538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:53.361929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.361929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.361929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2e892fa-35ad-4f29-98e1-a38bb3c63f29 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.240066 Oct 03 16:03:53.362497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.362599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 292/609] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:53 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:03:53.362693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.362693 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.363329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.363833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.364310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.431039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.439045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3572823d-84ab-4fe4-b518-385df5ec1c84 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1290 microversion: 2.1 time: 0.088625 Oct 03 16:03:53.439609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 318/610] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:53 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:53.948739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:53.949487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:53.955450 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.955933 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.956368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.957140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.957558 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.957974 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.098415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.107301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e24f9f24-8e84-40c4-ace8-f0ff1b24d503 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1722 microversion: 2.1 time: 0.162534 Oct 03 16:03:54.107863 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 293/611] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:53 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:54.374675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:54.375304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:54.381993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.382581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.383017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.383696 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.384138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.384555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.385819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:54.386421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:54.392783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.393260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.393696 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.394367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.394810 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.395221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.577663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.584574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.585646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fee86762-3a4e-4d07-b41c-42cb2f1b6086 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.214787 Oct 03 16:03:54.586233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 319/612] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:54 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:54.591074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:54.591668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:54.593184 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.594941 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.596309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9febd896-c8ba-4513-9c38-26412c0b3368 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.214333 Oct 03 16:03:54.597049 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 294/613] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:54 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:54.603805 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.604291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.604747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.605450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.605896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.606315 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.670447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:54.678751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4a257b4-e446-43df-83ef-37d6190763c2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1290 microversion: 2.1 time: 0.091591 Oct 03 16:03:54.679307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 320/614] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:54 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:55.131514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:55.132046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:55.138012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.138491 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.138933 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.139619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.140071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.140497 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.279092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.288203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6979474b-f4ce-42b3-aa9c-ea81a9451ad0 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1728 microversion: 2.1 time: 0.160701 Oct 03 16:03:55.288790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 295/615] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:55 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:55.310325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:55.310818 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:55.316997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.317487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.317974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.318774 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.319228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.320099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.396429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c67781e-63ea-43cc-9530-e47f1704547b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089451 Oct 03 16:03:55.397236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 321/616] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:03:55 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:55.610267 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:55.611149 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:55.617805 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.618573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.619171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.620066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.621360 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.622000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.631960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:55.633013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:55.643141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.646877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.647634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.648379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.648876 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.649509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.847688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.851806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.855424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:55.864664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.865160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7738dc3-ae0f-4a26-a7c6-66f2fae3d4f0 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.258755 Oct 03 16:03:55.866048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 296/617] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:55 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:55.866161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.867268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85894907-54b3-404d-8ed7-f4168df01347 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.244490 Oct 03 16:03:55.867943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 322/618] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:55 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:55.871109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:55.871846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:55.879308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.879903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.881164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.881936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:55.882486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:55.883002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:55.948168 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.957777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c55e702-b8d0-4897-9c76-b4949a8cdebb tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1290 microversion: 2.1 time: 0.090528 Oct 03 16:03:55.958862 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 297/619] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:55 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:56.080497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:56.081014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:56.090121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.091725 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.092369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.094473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.095138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.098080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.207862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'services' on Instance uuid 63ff1918-7d0c-422f-a56b-75ce0ea903cb {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:56.285725 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d63157f-6396-4ddc-a01d-774abe8c146c tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb/os-volume_attachments/47d4cffa-2bf2-4886-bf47-ec3018aa16d5" status: 202 len: 0 microversion: 2.1 time: 0.208772 Oct 03 16:03:56.286024 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 323/620] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:03:56 2022] DELETE /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb/os-volume_attachments/47d4cffa-2bf2-4886-bf47-ec3018aa16d5 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:03:56.895220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:56.899717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:56.902079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:56.906696 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:56.906871 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:56.923377 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.923878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.924363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.925575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.925694 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.926105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.926317 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.926527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.927474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.928539 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.936493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.937265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.259701 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.273551 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.279340 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.282990 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e758f50-58c1-463d-b180-c4f8b034c912 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.392348 Oct 03 16:03:57.284295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 324/621] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:56 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:57.288445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.291660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:57.305371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-504d0a98-a8c7-438d-8f00-823ee30f604b tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.413167 Oct 03 16:03:57.306577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.307284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.307800 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.318424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 298/622] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:56 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:57.324087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] Creating event network-changed:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:03:57.327893 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:57.328851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:57.332195 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fa58fecf-1a60-4353-8114-9b52fd808f2e req-3250f0b1-173e-468b-934d-154a59b9d3b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045285 Oct 03 16:03:57.336894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.337272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 325/623] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:57.337929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.338674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.340204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.340848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.341429 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.430681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:57.431636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:57.438739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.439506 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.440175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.441113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.441801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.443262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.489178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:03:57.603027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-392b6ab1-e843-4494-be42-ff6544c83070 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 204 len: 0 microversion: 2.1 time: 0.175967 Oct 03 16:03:57.609466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 326/624] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:03:57 2022] DELETE /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 16:03:57.617711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:57.619061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:57.627334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.627862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.628218 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.628394 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.629014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.629624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.630109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.637604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3753ad02-02d6-469f-bad8-845eb5b0b3d1 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.318002 Oct 03 16:03:57.638362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 299/625] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:57 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:57.869914 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.878196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51ae2f62-4396-4d5b-b040-2cbdb2efe9d2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1515 microversion: 2.1 time: 0.266638 Oct 03 16:03:57.893318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 327/626] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:57 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:58.049629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e40c96-5f19-40a7-be49-dd0c05c3c343", "tag": "cf761e51-dba3-432f-af44-45799f73b23a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:58.060633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.061380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.061999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.073948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] Creating event network-changed:cf761e51-dba3-432f-af44-45799f73b23a for instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 on hv-cinder-84456 Oct 03 16:03:58.078668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7f0892f2-ecf2-44d9-aed3-9f7325ec76c0 req-8544a02f-a266-4c1f-a5c2-71f2f55944e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032681 Oct 03 16:03:58.079266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 300/627] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:58.308464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:58.309153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:58.315248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.315724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.316159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.316874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.317326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.318514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.331962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:58.332792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:58.340044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.340560 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.341092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.341861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.342389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.342886 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.509224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.517227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.518707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.519812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81845c6c-83da-4f3a-ac55-64e812d5b2d7 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.215518 Oct 03 16:03:58.520370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 328/628] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:58 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:03:58.522490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.530273 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b46a177-e753-4446-8aeb-6894036be7dc tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.202635 Oct 03 16:03:58.530898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 301/629] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:58 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:03:58.660273 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:58.660921 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:58.667457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.667938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.668365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.669069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.669527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.669953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.794485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.802692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45d7be50-c1a9-4a20-990c-8f57ab785733 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.145646 Oct 03 16:03:58.803255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 329/630] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:58 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:58.902442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:58.903020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:58.909013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.909486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.909913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.910588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.911033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.911987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.039284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:59.047252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4be2b062-9ab6-44a2-8495-35015b0d613f tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1515 microversion: 2.1 time: 0.148706 Oct 03 16:03:59.047817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 302/631] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:58 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:59.365351 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:59.375524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.376157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.376694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.390375 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] Creating event network-changed:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:03:59.398011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-644b8143-9617-45e1-b336-be832e6603b0 req-9516e48e-16bb-490d-94d1-9f5812f40d37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036702 Oct 03 16:03:59.399221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 330/632] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:59.547091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:59.547654 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:59.567251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:59.567251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:59.571571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.572281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.572763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.573525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.573992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.577033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.579524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.580048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.580492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.595282 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.600369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.601031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.648623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:00.136207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.144536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd49d1f5-25e6-487f-b62a-710f33d62bf9 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.594412 Oct 03 16:04:00.145357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 331/633] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:59 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:00.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "name": "network-vif-plugged", "status": "completed", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:00.170414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.171868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.172398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.187300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] Creating event network-vif-plugged:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:04:00.193457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6d0071a6-56df-4da1-a703-4986ec0f8067 req-6f11afe5-1eb1-4d78-8ee7-e657487f8e77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040448 Oct 03 16:04:00.194253 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 332/634] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:00.199484 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:00.200163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:00.206955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.207557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.208319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.209088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.209948 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.210075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.353074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.368056 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.370213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.371751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4417904-1541-454c-a414-2a93328f0935 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.830746 Oct 03 16:04:00.395650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 303/635] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:03:59 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:00.402843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:00.403685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:00.413592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.414091 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.414525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.415759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.416892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.418353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.465070 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.465557 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.466133 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.466984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'fault' on Instance uuid 63ff1918-7d0c-422f-a56b-75ce0ea903cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:00.563044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.571016 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6561b6b9-ca1c-485f-b082-f5d765c0f87d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1309 microversion: 2.1 time: 0.173100 Oct 03 16:04:00.571588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 304/636] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:00 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:00.617653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:00.625682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96bcb2f2-6ad8-4b9f-802d-e2bb0cf074b4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.430475 Oct 03 16:04:00.626260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 333/637] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:00 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:01.167685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:01.168326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:01.174342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.174812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.175237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.175915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.176362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.176803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.310807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.319455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e023fd7-3d1e-4e67-a8ed-51acf20536b7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.155612 Oct 03 16:04:01.320457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 305/638] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:01 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:01.398988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:01.399585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:01.405567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.406040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.406499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.407129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.407570 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.407989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.413446 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ff1918-7d0c-422f-a56b-75ce0ea903cb", "name": "network-vif-deleted", "tag": "1e403651-934b-47dc-9807-9fec7b0415a4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:01.422786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.423202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.423624 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.428041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:01.435970 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] Creating event network-vif-deleted:1e403651-934b-47dc-9807-9fec7b0415a4 for instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb on hv-cinder-84456 Oct 03 16:04:01.440703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5908fe3f-e79d-4e26-a15b-328412c5a408 req-bb6f547e-ddc9-43a3-a419-eadfdd0701bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Oct 03 16:04:01.441326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 306/639] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:04:01.539339 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.547781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.549249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.550352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13b734c1-6b44-414c-999b-ac26efe34883 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.155385 Oct 03 16:04:01.550904 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 334/640] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:01 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:01.593276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:01.597708 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:01.598482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:01.606148 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.606625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.607057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.607739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.608189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.608612 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.640627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.641136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.641568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.642007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'fault' on Instance uuid 63ff1918-7d0c-422f-a56b-75ce0ea903cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:01.647434 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:01.648037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:01.654047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.654520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.654955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.655637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:01.656086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:01.656503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.684467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.692211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3747111-0b18-47d3-b5b2-92f5fd2df04a tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1309 microversion: 2.1 time: 0.100334 Oct 03 16:04:01.692981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 307/641] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:01 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:01.839723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.847299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0edff4ac-fbc5-4e47-8bf8-b4985ed91660 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.203645 Oct 03 16:04:01.847849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 335/642] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:01 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:02.342377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:02.342989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:02.344866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:02.350546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.351104 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.351638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.352391 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.352980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.353398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.494790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:02.502551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c1a7918-709c-4ee1-bafd-e21d0928daf4 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.164431 Oct 03 16:04:02.503115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 308/643] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:02 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:02.576150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:02.576775 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:02.582724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.583292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.583918 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.584602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.585078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.585497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.712097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:02.715778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:02.716382 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:02.720743 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:02.722195 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:02.722735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.723210 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.723321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-774a000b-d064-468b-b8eb-cc7efe196e82 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1402 microversion: 2.20 time: 0.151132 Oct 03 16:04:02.724215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.724523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 336/644] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:02 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1402 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:02.727054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.727530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.727961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.759112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.759584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.760012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.760451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'fault' on Instance uuid 63ff1918-7d0c-422f-a56b-75ce0ea903cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:02.803340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:02.810977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eee183d5-9324-4579-9219-c50f056286bc tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1309 microversion: 2.1 time: 0.099448 Oct 03 16:04:02.811541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 309/645] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:02 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:02.870214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:02.870742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:02.876541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.877043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.877470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:02.878141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:02.878584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:02.879005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.007464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.015114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ef209a6-f799-4c9a-9b8a-2bb35fb24f77 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.148736 Oct 03 16:04:03.015670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 337/646] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:02 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:03.526257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:03.526862 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:03.532887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.533361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.533789 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.534460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.534907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.535322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.663469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.671120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a036f58d-485b-4116-a1c3-e244ef110726 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.148942 Oct 03 16:04:03.671703 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 310/647] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:03 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:03.748541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:03.749174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:03.755745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.756215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.756641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.757342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.757793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.758206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.834784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:03.835509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:03.842533 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.844020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.844567 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.845323 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.846192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.846761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.885796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.886423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.886868 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.887613 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lazy-loading 'fault' on Instance uuid 63ff1918-7d0c-422f-a56b-75ce0ea903cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:03.901535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.912603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.914482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.915861 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2aee8d20-2f06-46cf-9f5e-6880ac9e5335 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1594 microversion: 2.20 time: 0.171133 Oct 03 16:04:03.916471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 338/648] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:03 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:04:03.930839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59791fcdee41149fce9b8a950963fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c41c14b0b3411d9b7e39e3983f2ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:03.939443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cd77ce7-3203-4105-b14e-f48cc0560f3d tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 200 len: 1309 microversion: 2.1 time: 0.108735 Oct 03 16:04:03.940264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 311/649] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:03 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:03.940378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:03.940969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:03.947837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.948387 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.949049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.949807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:03.950323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:03.950810 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:03.955587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:04.033287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-deda4098-e8a4-4271-8ab0-58384d87f488 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096686 Oct 03 16:04:04.034156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 339/650] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Oct 3 16:04:03 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 16:04:04.039885 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:04.040499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:04.046936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.047420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.047856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.048548 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.049201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.049639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.188103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:04.197837 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94ca9d3e-3c75-413a-bbb2-9860c95e16c7 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.162673 Oct 03 16:04:04.198616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 312/651] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:04 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:04.695161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:04.695767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:04.701768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.702246 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.702675 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.703355 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.703800 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.704214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.836352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:04.844318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41cdc66a-663c-43bb-9b34-8d0fe72097e7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1568 microversion: 2.1 time: 0.153709 Oct 03 16:04:04.844902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 340/652] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:04 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:04.868194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:04.868913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:04.875422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.875975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.876477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.877200 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.877651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.878073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.908272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 16:04:04.965173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:04.965912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] [instance: 63ff1918-7d0c-422f-a56b-75ce0ea903cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:04.972279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.972794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.973232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.974808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:04.975715 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:04.976142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:04.986256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc723176-86e5-49ff-9574-b51237f7877c tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "POST /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb/action" status: 202 len: 0 microversion: 2.1 time: 0.122448 Oct 03 16:04:04.986984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 313/653] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:04:04 2022] POST /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:04:04.993980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] HTTP exception thrown: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Request method failure captured: Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb HTTP/1.1 Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwdrMoqwkQL4_r6L2GCdRp1lVxYIyFpnH8LYpFQgK6D3YpETIo_86is_5xjdHy6i56PjBbP9hQ50ObQLvp7sllyxghOna4oT20kiqnF2HgXxFTTW8ppOxnK4G-Uu4tidNxz1lwUP-yCRIIAqCnCppjoalPKtOY83fkXT2xsxX_y8lFs Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f8c41c14b0b3411d9b7e39e3983f2ccd Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:04:04.995631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8c41c14b0b3411d9b7e39e3983f2ccd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8c41c14b0b3411d9b7e39e3983f2ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f8c41c14b0b3411d9b7e39e3983f2ccd Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-756409839 Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotTestJSON-756409839-project Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 5d59791fcdee41149fce9b8a950963fc Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotTestJSON-756409839-project Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. Oct 03 16:04:04.998334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '63ff1918-7d0c-422f-a56b-75ce0ea903cb'} Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:04:04.999656 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. Oct 03 16:04:05.001954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:05.004563 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:05.004780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] Returning 404 to user: Instance 63ff1918-7d0c-422f-a56b-75ce0ea903cb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:04:05.004917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:05.005012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e92e0f5-b559-44d5-94c2-7c203d076fe2 tempest-VolumesSnapshotTestJSON-756409839 tempest-VolumesSnapshotTestJSON-756409839-project] 10.222.0.33 "GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb" status: 404 len: 111 microversion: 2.1 time: 0.036836 Oct 03 16:04:05.005012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 341/654] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:04 2022] GET /compute/v2.1/servers/63ff1918-7d0c-422f-a56b-75ce0ea903cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:04:05.017079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:05.017761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:05.018201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:05.019010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:05.019993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:05.020965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:05.225416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:05.226330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:05.235120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:05.237360 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:05.237994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:05.238896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:05.240953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:05.241770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:05.250194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:05.262075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5835bdcd-c112-42e5-b21c-440970a27271 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1576 microversion: 2.1 time: 0.268958 Oct 03 16:04:05.264767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 314/655] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:04 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:05.410244 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:05.432865 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:05.433346 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:05.434231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:05.453962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] Creating event network-changed:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:04:05.463047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c6c3a812-502d-4b29-8d5e-b1a943bac77c req-982cce87-881f-40f1-9e65-0760d9514706 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056269 Oct 03 16:04:05.463651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 315/656] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:04:05.496801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:05.510872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe76dc5c-ccaf-4dda-ab63-11880a122433 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.291140 Oct 03 16:04:05.512403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 342/657] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:05 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:06.289720 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:06.290421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:06.297214 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:06.297696 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:06.298134 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:06.298825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:06.299281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:06.299704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:06.446453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:06.455071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fefe8f03-d37f-4d3a-8fe5-09fe5d53c209 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1518 microversion: 2.1 time: 0.169490 Oct 03 16:04:06.456428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 316/658] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:06 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:06.535640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:06.536399 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:06.547658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:06.548441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:06.554141 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:06.555202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:06.556050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:06.556580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:06.725602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:06.733307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bb804ee-4b56-4c3a-ac40-9d8cdab72424 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.201598 Oct 03 16:04:06.734052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 343/659] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:06 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:07.480139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:07.480786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:07.487334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:07.487814 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:07.488282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:07.488994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:07.489741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:07.490175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:07.618033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:07.625791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-467868fb-06d5-4972-a8d6-c48d1e8768b1 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.149610 Oct 03 16:04:07.626392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 317/660] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:07 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:07.757169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:07.757792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:07.763678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:07.764153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:07.764580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:07.765280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:07.765728 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:07.766143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:07.895175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:07.903444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c0d4b44-d941-47a6-905e-eff5acacea2e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.150610 Oct 03 16:04:07.904011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 344/661] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:07 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:08.649973 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:08.650678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:08.657161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:08.657640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:08.658071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:08.658758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:08.659209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:08.659627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:08.694938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e40c96-5f19-40a7-be49-dd0c05c3c343", "name": "network-vif-plugged", "status": "completed", "tag": "cf761e51-dba3-432f-af44-45799f73b23a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:08.706783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:08.707306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:08.708446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:08.722081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] Creating event network-vif-plugged:cf761e51-dba3-432f-af44-45799f73b23a for instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 on hv-cinder-84456 Oct 03 16:04:08.729031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8bcda601-2236-42a0-a133-155814197c25 req-83ea5347-dc78-42cc-a239-24d2b707c2ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038310 Oct 03 16:04:08.729907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 345/662] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:04:08.811767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:08.820455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47ad8433-471d-4855-a97a-f015ec18484d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.174334 Oct 03 16:04:08.821103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 318/663] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:08 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:08.925789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:08.926653 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:08.933083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:08.933562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:08.933997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:08.934692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:08.935130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:08.935549 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:09.068781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:09.078097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53949b8b-2989-4c48-836a-a5010b52a42b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.156234 Oct 03 16:04:09.078574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 346/664] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:08 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:09.844827 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:09.845432 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:09.852302 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:09.852803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:09.853231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:09.853904 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:09.854343 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:09.854769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:10.105262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:10.106705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:10.113940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:10.115218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:10.115866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:10.116819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:10.117460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:10.118082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:10.125851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:10.134536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7d48e5f-1653-4702-8bcb-01d51cf8ab35 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.293497 Oct 03 16:04:10.136117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 319/665] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:09 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:10.259424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:10.268072 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb0f7fa1-58ed-478d-8b35-939e8119af22 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.166703 Oct 03 16:04:10.268638 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 347/666] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:10 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:10.762003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "name": "network-vif-unplugged", "status": "completed", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:10.772299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:10.772798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:10.773224 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:10.783802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] Creating event network-vif-unplugged:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:04:10.788961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-79085d38-fa4a-41e5-85d2-d84a175ff9dd req-782411ac-f920-406b-a131-d50c72829a50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030637 Oct 03 16:04:10.789528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 320/667] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:11.159009 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:11.159614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:11.165871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:11.166443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:11.166941 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:11.167700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:11.168216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:11.168698 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:11.292902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:11.293609 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:11.300786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:11.302337 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:11.303448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:11.304186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:11.304874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:11.305485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:11.307576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:11.321779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25d412dc-ee77-4585-a439-38ec1d169dfe tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.166130 Oct 03 16:04:11.322027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 348/668] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:11 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:11.439856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:11.448688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b31ecec7-2b3f-4d72-b08f-148dd34513ed tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1362 microversion: 2.1 time: 0.160894 Oct 03 16:04:11.449401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 321/669] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:11 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:12.344836 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:12.345504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:12.351837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.352318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.352772 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.353456 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.353908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.354329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.474528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:12.475791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:12.482843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.483535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.484165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.485042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.485681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.486255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.492391 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:12.501056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c153db6e-aa47-4562-82a6-c585924240cd tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.160083 Oct 03 16:04:12.512755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 349/670] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:12 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:12.644095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:12.647878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:12.654534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ae46e45-c30b-49e6-ab7b-008e0798668e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1548 microversion: 2.1 time: 0.183906 Oct 03 16:04:12.655107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 322/671] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:12 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:12.678156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:12.678645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:12.684496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.685010 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.685446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.686133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:12.686584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:12.687004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:12.773059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a101c1d3-e1d5-4c2f-a6a7-a19f2b4f0909 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099830 Oct 03 16:04:12.780989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 350/672] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:04:12 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:13.526833 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:13.527410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:13.536549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:13.537072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:13.537517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:13.538215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:13.538667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:13.539084 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:13.673470 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:13.682580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5be8e2a-82b6-42c7-9416-8ac94eaecb02 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.159054 Oct 03 16:04:13.682580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 323/673] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:13 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:13.730070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e40c96-5f19-40a7-be49-dd0c05c3c343", "tag": "cf761e51-dba3-432f-af44-45799f73b23a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:13.739664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:13.740128 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:13.740550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:13.751437 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] Creating event network-changed:cf761e51-dba3-432f-af44-45799f73b23a for instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 on hv-cinder-84456 Oct 03 16:04:13.756965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-58eb8538-3636-4d15-ab43-c1bf3b1115b5 req-5d267893-acaf-48e0-8f1c-8ea5b7bc4ea6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Oct 03 16:04:13.757543 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 351/674] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:14.706138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:14.706746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:14.716224 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:14.716704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:14.717170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:14.717870 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:14.718318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:14.718759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:14.859092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:14.867356 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-204d194b-8e1b-4c13-8ab8-397f786ae4e5 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.165158 Oct 03 16:04:14.867906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 324/675] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:14 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:15.891585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:15.892274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:15.899354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:15.899856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:15.900290 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:15.901020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:15.901499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:15.901920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:16.032928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:16.041177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f6a0b2b-4852-45ee-ad0c-70daa308f6a3 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.154040 Oct 03 16:04:16.041784 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 352/676] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:15 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:17.065678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:17.066279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:17.073281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:17.073801 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:17.074228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:17.074903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:17.075347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:17.075757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:17.211841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:17.219864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4b5b227-fa9b-4c37-a718-7d3198bb7fc7 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.158319 Oct 03 16:04:17.220442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 325/677] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:17 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:18.243761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:18.244369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:18.250262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:18.250738 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:18.251196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:18.251873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:18.252325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:18.252758 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:18.383975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:18.393061 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc30db43-69a7-4973-8ef7-7b68734306bb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.152856 Oct 03 16:04:18.393854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 353/678] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:18 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:19.417173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:19.417786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:19.424203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:19.424675 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:19.425142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:19.425820 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:19.426831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:19.427246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:19.563098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:19.571743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dfdfd87-e46e-4621-a82d-bb44c2ad7b92 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.158425 Oct 03 16:04:19.572441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 326/679] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:19 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:20.598606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:20.599202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:20.605221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:20.605695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:20.606125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:20.606815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:20.607547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:20.607966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:20.736263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:20.744912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-615a42fd-22e4-4a14-970d-52af5f26ee0a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.150241 Oct 03 16:04:20.745475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 354/680] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:20 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:21.745394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "name": "network-vif-plugged", "status": "completed", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:21.758059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:21.758550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:21.759268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:21.767504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:21.768146 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:21.772697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] Creating event network-vif-plugged:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:04:21.774849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:21.775346 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:21.775770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:21.776469 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:21.776949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:21.777373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:21.778293 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a6cf889a-058a-4b8e-a177-4862ba1f0ec8 req-f2ec5bc8-b10a-4210-afe2-585a014fcb50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036430 Oct 03 16:04:21.779526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 327/681] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:21.909996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:21.918765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ddfe8e81-315e-4572-8d6e-fad89d052dad tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.155035 Oct 03 16:04:21.919342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 355/682] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:21 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:22.942940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:22.943556 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:22.950344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:22.950817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:22.951247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:22.951940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:22.952377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:22.952825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:23.088911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:23.096883 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dad03de2-ed72-4f92-8767-f491d0906215 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1574 microversion: 2.1 time: 0.158763 Oct 03 16:04:23.097449 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 328/683] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:22 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:24.122404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:24.122946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:24.125052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:24.130928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:24.131408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:24.131841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:24.132529 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:24.133013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:24.133473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:24.281060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:24.289681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a2e5081-ded0-476f-9640-cd40fc21766a tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1561 microversion: 2.1 time: 0.171241 Oct 03 16:04:24.290271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 356/684] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:24 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:31.571407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:31.571906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:31.573864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:31.579211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:31.579692 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:31.580125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:31.580843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:31.581295 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:31.581714 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:31.667730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'services' on Instance uuid a5fb7e1a-6583-4305-b5aa-5c6c29643641 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:31.739739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e43a0665-e2a6-494d-a152-7614f217c58b tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments/2eb7ffb9-ad3a-4735-8917-3c41ef654878" status: 202 len: 0 microversion: 2.1 time: 0.172874 Oct 03 16:04:31.740337 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 329/685] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:04:31 2022] DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments/2eb7ffb9-ad3a-4735-8917-3c41ef654878 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:04:31.748781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:31.751371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:31.757957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:31.758480 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:31.758902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:31.759576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:31.760040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:31.760462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:31.792338 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3c957bc-132b-4b92-aaf9-12a293dcdeba tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Oct 03 16:04:31.792872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 357/686] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:04:31 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:32.806879 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:32.809199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:32.815383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:32.815858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:32.816292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:32.816996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:32.817513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:32.819045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:32.847811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d084ee1-c24e-4d6f-a497-d482468c7a30 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046907 Oct 03 16:04:32.848363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 330/687] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:04:32 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:04:32.923991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:32.924483 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:32.930985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:32.931471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:32.931937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:32.932623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:32.933105 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:32.933528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:32.952066 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:32.960060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:04:33.033855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41fb4e04-0936-4196-ba6d-089115479cd2 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 204 len: 0 microversion: 2.1 time: 0.113548 Oct 03 16:04:33.034629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 358/688] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:04:32 2022] DELETE /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:04:33.044662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:33.045300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:33.051256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:33.052440 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:33.053093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:33.053808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:33.054262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:33.054682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:33.186795 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:33.194661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e9d6627-5909-46af-a639-cc2aad76a224 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1688 microversion: 2.1 time: 0.154720 Oct 03 16:04:33.195222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 331/689] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:33 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:34.217914 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:34.218607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:34.224601 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:34.225114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:34.225552 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:34.226231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:34.226678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:34.227097 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:34.355432 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:34.363117 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c95acebd-1531-4bb4-9bb2-370dbea500f7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1688 microversion: 2.1 time: 0.149708 Oct 03 16:04:34.363672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 359/690] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:34 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:35.386289 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:35.386892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:35.393478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:35.393955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:35.394390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:35.395075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:35.395529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:35.395951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:35.526459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:35.534114 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8dc6e7e-7879-4f93-b4ed-eaa1034b8a61 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1688 microversion: 2.1 time: 0.151714 Oct 03 16:04:35.534669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 332/691] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:35 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:36.557894 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:36.558495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:36.564420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:36.564941 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:36.565369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:36.566051 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:36.566496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:36.566910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:36.697196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:36.704899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26154a47-39e1-4c42-8bce-fc1d71e4fe31 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1688 microversion: 2.1 time: 0.150907 Oct 03 16:04:36.705466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 360/692] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:36 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:37.685846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fb7e1a-6583-4305-b5aa-5c6c29643641", "name": "network-vif-deleted", "tag": "48b1e08a-0e36-4575-8b9c-a7c71f70f9ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:37.698200 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:37.698683 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:37.699140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:37.712411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] Creating event network-vif-deleted:48b1e08a-0e36-4575-8b9c-a7c71f70f9ac for instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 on hv-cinder-84456 Oct 03 16:04:37.718645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-247b7a43-6e32-48e3-b498-7258abe819a9 req-e78b8198-c31b-4e96-84d1-0e82fade5b03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Oct 03 16:04:37.719249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 333/693] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:37.728436 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:37.729077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:37.735576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:37.736231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:37.736874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:37.740923 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:37.741395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:37.741822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:37.807915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:37.816384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7887f580-6a11-4154-beaa-226e898e00e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 200 len: 1330 microversion: 2.1 time: 0.092053 Oct 03 16:04:37.830485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 361/694] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:37 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:38.841039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:38.841778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: a5fb7e1a-6583-4305-b5aa-5c6c29643641] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:38.848331 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:38.848842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:38.849508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:38.850213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:38.850670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:38.851092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:38.865699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] HTTP exception thrown: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Request method failure captured: Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 HTTP/1.1 Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbVZaQBQ2APGHTbpDb8MfEnlC_Hu8J1x4rJLy299mha70Q2e7JP4CM2b9nqMz9n5mWCa8mXe4MTXeIh-s5fjaSy9lCgAUJm6GQcdTUwwCgEqTW1aVX6MoTHYyTpP_TipQYNbeaQAwwdyqMVcUtOBg5lSip8LwroudXuhkI4Y9cUNrk Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:04:38.867367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2ed0fa1c2fe47a485c26522b2e81b8b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: b3098a7103d94b29bc4bce30cfd05bc6 Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. Oct 03 16:04:38.869059 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'a5fb7e1a-6583-4305-b5aa-5c6c29643641'} Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:04:38.869866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. Oct 03 16:04:38.871169 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:38.872316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Returning 404 to user: Instance a5fb7e1a-6583-4305-b5aa-5c6c29643641 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:04:38.872316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cd02321-cc1d-4c2f-9c7f-c66f04a3cc03 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641" status: 404 len: 111 microversion: 2.1 time: 0.032826 Oct 03 16:04:38.872316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 334/695] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:38 2022] GET /compute/v2.1/servers/a5fb7e1a-6583-4305-b5aa-5c6c29643641 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:04:38.877996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dce45116-9bb0-4bae-99ce-c60881a49d87 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '.version_select at 0x7f8174f3b040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:38.898388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dce45116-9bb0-4bae-99ce-c60881a49d87 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809123124" status: 202 len: 0 microversion: 2.1 time: 0.024569 Oct 03 16:04:38.898956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 362/696] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809123124 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:04:41.768766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:41.769264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:41.775631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:41.776099 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:41.776525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:41.777224 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:41.777670 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:41.778088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:41.805162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:04:41.877947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56e2fc88-6b82-4447-a4ee-212cc4ae3563 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 204 len: 0 microversion: 2.1 time: 0.112720 Oct 03 16:04:41.878485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 335/697] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:04:41 2022] DELETE /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:04:41.887371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:41.887980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:41.893915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:41.894397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:41.894828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:41.895622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:41.896078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:41.896499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:42.030056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:42.038337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8032efd5-ca91-4913-8851-b716e6a17e3f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1507 microversion: 2.1 time: 0.155022 Oct 03 16:04:42.038893 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 363/698] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:41 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:43.062968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:43.063671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:43.070916 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:43.071401 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:43.071848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:43.072532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:43.073015 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:43.073444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:43.201735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:43.210083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63e7cf63-15a1-4a96-bc41-d7a9b1f7a925 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1507 microversion: 2.1 time: 0.151386 Oct 03 16:04:43.210674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 336/699] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:43 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:44.234798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:44.235729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:44.242098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:44.242572 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:44.242996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:44.243670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:44.244402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:44.244845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:44.379645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:44.387378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bda2e5b7-bb51-4d21-b2c2-b7ca873f73c6 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1507 microversion: 2.1 time: 0.157232 Oct 03 16:04:44.387935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 364/700] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:44 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:04:44.959961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5788363a-33d3-4304-a1eb-ff548eff183c", "name": "network-vif-deleted", "tag": "49490488-b358-414a-b2e8-87117b319960"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:44.970285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:44.970793 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:44.971266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:44.976189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:44.983865 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] Creating event network-vif-deleted:49490488-b358-414a-b2e8-87117b319960 for instance 5788363a-33d3-4304-a1eb-ff548eff183c on hv-cinder-84456 Oct 03 16:04:44.988881 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-01058e40-075c-4a30-9339-c6499f7f6cb9 req-018bd366-b471-4cc4-ba5b-2489e0ce8e7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159860 Oct 03 16:04:44.989473 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 337/701] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:45.410632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:45.411185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:45.417475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:45.417958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:45.418395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:45.419082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:45.419538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:45.419967 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:45.452871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:45.453285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:45.453719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:45.454160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'fault' on Instance uuid 5788363a-33d3-4304-a1eb-ff548eff183c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:45.495268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:45.502961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d303f1f-3d89-4950-8d22-cbb5f38f7740 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 200 len: 1312 microversion: 2.1 time: 0.096702 Oct 03 16:04:45.503551 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 365/702] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:45 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:46.528304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:46.529028 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 5788363a-33d3-4304-a1eb-ff548eff183c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:46.536822 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.537303 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.537742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.538426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.538877 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.539299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.553327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] HTTP exception thrown: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Request method failure captured: Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c HTTP/1.1 Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbVZaQBQ2APGHTbpDb8MfEnlC_Hu8J1x4rJLy299mha70Q2e7JP4CM2b9nqMz9n5mWCa8mXe4MTXeIh-s5fjaSy9lCgAUJm6GQcdTUwwCgEqTW1aVX6MoTHYyTpP_TipQYNbeaQAwwdyqMVcUtOBg5lSip8LwroudXuhkI4Y9cUNrk Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:04:46.554903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2ed0fa1c2fe47a485c26522b2e81b8b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: b3098a7103d94b29bc4bce30cfd05bc6 Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. Oct 03 16:04:46.556195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '5788363a-33d3-4304-a1eb-ff548eff183c'} Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:04:46.556988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. Oct 03 16:04:46.558357 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:04:46.559633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Returning 404 to user: Instance 5788363a-33d3-4304-a1eb-ff548eff183c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:04:46.559633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f507ba2-93c0-4753-879a-49f31558472f tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c" status: 404 len: 111 microversion: 2.1 time: 0.032960 Oct 03 16:04:46.559633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 338/703] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:46 2022] GET /compute/v2.1/servers/5788363a-33d3-4304-a1eb-ff548eff183c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:04:46.564975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:46.565469 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:46.572194 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.572610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.573070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.573746 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.574190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.574606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.599850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:04:46.675343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5bef135e-81c8-4174-aee7-5ef38018cf3a tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 204 len: 0 microversion: 2.1 time: 0.113971 Oct 03 16:04:46.676020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 366/704] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:04:46 2022] DELETE /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:04:46.684849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:46.685469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:46.691336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.691882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.692629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.693408 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:46.693865 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:46.694291 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:46.823484 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:46.831061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6372141d-be99-49ee-9026-24cf0b6a6f78 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.150100 Oct 03 16:04:46.831615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 339/705] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:46 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:47.854440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:47.855190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:47.861293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:47.861763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:47.862191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:47.862862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:47.863310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:47.863754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:47.994596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:48.002439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5bd23e9c-d8df-444a-9e4f-53d24a958832 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.152186 Oct 03 16:04:48.002994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 367/706] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:47 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:49.025315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:49.025856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:49.032382 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:49.032897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:49.033329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:49.034011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:49.034460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:49.034880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:49.168144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:49.175897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72196ecb-aaa9-47e7-8cf7-c1d822bbc6e7 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1520 microversion: 2.1 time: 0.154495 Oct 03 16:04:49.177831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 340/707] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:49 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:49.199298 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:49.199801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:49.205818 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:49.206300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:49.206733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:49.208023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:49.208455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:49.208912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:49.235276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c55182f9-a58f-4072-83dc-e0b532558a8a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/ips" status: 200 len: 152 microversion: 2.20 time: 0.145362 Oct 03 16:04:49.235802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 368/708] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Oct 3 16:04:49 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/ips => generated 152 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 16:04:49.765137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7100bc2d-5133-4f37-a224-1eba62ee2aab", "name": "network-vif-deleted", "tag": "cc1af7f2-81c4-4fc8-858e-39dbf9a276f6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:49.776601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:49.777109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:49.777530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:49.790536 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] Creating event network-vif-deleted:cc1af7f2-81c4-4fc8-858e-39dbf9a276f6 for instance 7100bc2d-5133-4f37-a224-1eba62ee2aab on hv-cinder-84456 Oct 03 16:04:49.795854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3b484c8c-e18c-4870-b3c0-6bf747d227fa req-dd2c9c25-1380-427e-8199-37696099028f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Oct 03 16:04:49.796454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 341/709] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:04:50.199371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:50.199979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:50.206027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:50.206503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:50.206935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:50.207771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:50.208224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:50.208646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:50.239433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:50.239904 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:50.240330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:50.240796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lazy-loading 'fault' on Instance uuid 7100bc2d-5133-4f37-a224-1eba62ee2aab {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:50.282366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3098a7103d94b29bc4bce30cfd05bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed0fa1c2fe47a485c26522b2e81b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:50.290087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0815b74-6288-4de6-80b1-21e999ce7a40 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 200 len: 1311 microversion: 2.1 time: 0.094579 Oct 03 16:04:50.290642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 369/710] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:50 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:51.098936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:51.099564 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:51.106227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.106706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.107137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.107819 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.108269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.108689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.134290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lazy-loading 'flavor' on Instance uuid 489060aa-1904-4f0e-aed7-9ac1d9806dc7 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:04:51.312867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:51.313479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] [instance: 7100bc2d-5133-4f37-a224-1eba62ee2aab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:51.321548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.321665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.322154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.322916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.323369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.323788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.330482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-800d320f-17eb-4a38-9017-86ffa9811b46 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/action" status: 202 len: 0 microversion: 2.20 time: 0.235943 Oct 03 16:04:51.331453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 342/711] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 16:04:51 2022] POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:04:51.339106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] HTTP exception thrown: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Request method failure captured: Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab HTTP/1.1 Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbVZaQBQ2APGHTbpDb8MfEnlC_Hu8J1x4rJLy299mha70Q2e7JP4CM2b9nqMz9n5mWCa8mXe4MTXeIh-s5fjaSy9lCgAUJm6GQcdTUwwCgEqTW1aVX6MoTHYyTpP_TipQYNbeaQAwwdyqMVcUtOBg5lSip8LwroudXuhkI4Y9cUNrk Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:04:51.340771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2ed0fa1c2fe47a485c26522b2e81b8b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2ed0fa1c2fe47a485c26522b2e81b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f2ed0fa1c2fe47a485c26522b2e81b8b Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1038660835 Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: b3098a7103d94b29bc4bce30cfd05bc6 Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1038660835-project Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. Oct 03 16:04:51.342304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '7100bc2d-5133-4f37-a224-1eba62ee2aab'} Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:04:51.343098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. Oct 03 16:04:51.344324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:04:51.345450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] Returning 404 to user: Instance 7100bc2d-5133-4f37-a224-1eba62ee2aab could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:04:51.345535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:51.345625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b8d85f4-a1a1-4be9-ad20-b4416113fa76 tempest-ServerRescueNegativeTestJSON-1038660835 tempest-ServerRescueNegativeTestJSON-1038660835-project] 10.222.0.33 "GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab" status: 404 len: 111 microversion: 2.1 time: 0.033158 Oct 03 16:04:51.345713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:51.345794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 370/712] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:51 2022] GET /compute/v2.1/servers/7100bc2d-5133-4f37-a224-1eba62ee2aab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:04:51.348839 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.349688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.350062 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.350751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:51.351198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:51.351697 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:51.490530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:51.498842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:51.500421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:51.501699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c045bb5-f611-4910-9d17-78b54b5abed3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.164691 Oct 03 16:04:51.502255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 343/713] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:51 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:04:52.527924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:52.529231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:52.536142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:52.536988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:52.537605 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:52.538305 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:52.538744 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:52.539349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:52.778169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:52.786411 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:52.787909 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:52.789077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32719fa9-7740-4338-acfd-05fbcafe420a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.265152 Oct 03 16:04:52.789630 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 371/714] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:52 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:53.815323 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:53.816073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:53.823880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:53.824362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:53.824815 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:53.825717 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:53.826168 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:53.826582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:54.061947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:54.073041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:54.074725 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:54.076109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b1fe3a4-fefb-4db7-916d-5edd9d1ada51 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.264962 Oct 03 16:04:54.089042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 344/715] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:53 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:55.107088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:55.107795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:55.115525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:55.120479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:55.121125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:55.121557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:55.122259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:55.123641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:55.124124 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:55.296570 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:55.309938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:55.311450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:55.313043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6971cab-6f33-4fb1-9957-e26675ded2b5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.209776 Oct 03 16:04:55.313995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 372/716] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:55 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:56.345551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:56.346164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:56.353280 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:56.353838 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:56.354353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:56.355103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:56.355621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:56.356101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:56.563701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:56.572807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:56.574268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:56.575438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ce5a9b8-1714-4d66-a209-f3e5d53e0e56 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.233913 Oct 03 16:04:56.576012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 345/717] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:56 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:57.344036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:57.345242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:57.352043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.352855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.353480 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.354189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.354810 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.355404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.359526 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:57.383785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-537076db-cfa9-4119-88f6-65b5f000eb0a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/ips" status: 200 len: 145 microversion: 2.1 time: 0.249015 Oct 03 16:04:57.384364 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 373/718] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:04:57 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/ips => generated 145 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:04:57.539589 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:57.540112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:57.549502 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.550332 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.550995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.552075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.552756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.553377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.594971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:04:57.602750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:57.603368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:57.624312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.625011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.626362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.627496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.628555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.630607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.807174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e793fc47-dff5-4a81-a86f-1f0b9937cf35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 204 len: 0 microversion: 2.1 time: 0.281013 Oct 03 16:04:57.811001 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 346/719] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:04:57 2022] DELETE /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:04:57.824453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:57.825491 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:57.842757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.843876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.844844 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.845888 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:57.846433 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:57.847026 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:57.864583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:57.874423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:57.875976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:57.877270 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a138d531-e862-4c7d-a6b6-6ca8fd24623f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.279680 Oct 03 16:04:57.880309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 374/720] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:57 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:04:58.013246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:58.021763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56d9a0f6-71d0-4d56-aead-f49c5e6eddd1 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1575 microversion: 2.1 time: 0.208760 Oct 03 16:04:58.022338 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 347/721] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:57 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:58.828991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:04:58.835309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:58.845113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:58.846179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:58.846994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:58.847969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:58.849352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:58.850120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:58.906913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:58.907640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:58.915603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:58.916530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:58.917212 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:58.918175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:58.918852 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:58.919491 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:59.098988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:59.108156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:59.111534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:59.113672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f568c6da-0200-4cae-9eed-11d431584525 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.211812 Oct 03 16:04:59.129374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 348/722] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:04:58 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:04:59.137159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:59.137778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:59.143981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:59.145279 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:59.145915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:59.147238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:59.148018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:59.148604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:59.330452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:59.340017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-183d0c8b-29df-4bf4-9d10-6df0be0de0e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1575 microversion: 2.1 time: 0.209449 Oct 03 16:04:59.340927 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 349/723] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:59 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:59.374028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21d88ea4-89f5-4316-979e-52fda2123584 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549352 Oct 03 16:04:59.380197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 375/724] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:04:58 2022] POST /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:00.142917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:00.144090 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:00.151186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:00.151704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:00.152130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:00.153032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:00.153478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:00.153902 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:00.294728 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:00.307682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:00.309182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:00.310385 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8eafd65-5325-4f14-b0ba-4c5ef7afeb81 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.171410 Oct 03 16:05:00.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 350/725] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:00 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:00.365242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:00.365950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:00.372539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:00.373070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:00.373551 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:00.374259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:00.374718 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:00.375220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:00.537406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:00.554729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-953c132d-765a-4d46-845c-6612515c05b6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1575 microversion: 2.1 time: 0.194780 Oct 03 16:05:00.556231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 376/726] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:00 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:01.338968 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:01.339576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:01.346768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:01.347616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:01.348955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee7b689-24a1-4318-b643-8e02216f7dec", "name": "network-vif-deleted", "tag": "fa8d71f0-ca65-4c21-97c5-b323a708ab7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:01.349441 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:01.349978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:01.350433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:01.350946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:01.360958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:01.361786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:01.362480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:01.375674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] Creating event network-vif-deleted:fa8d71f0-ca65-4c21-97c5-b323a708ab7e for instance 2ee7b689-24a1-4318-b643-8e02216f7dec on hv-cinder-84456 Oct 03 16:05:01.385208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4dd482d0-c329-4136-beb5-3995a87a7490 req-8bb40e7f-e57b-4e31-b6ad-4f1a736dd8e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051785 Oct 03 16:05:01.388030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 351/727] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:01.588768 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:01.599681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:01.602384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:01.604020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc594b7f-f4c0-49d3-a90c-60a84746ed8e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.269389 Oct 03 16:05:01.605196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 377/728] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:01 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:05:01.611798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:01.612745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:01.620150 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:01.622074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:01.622762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:01.623703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:01.624423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:01.625126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:01.706361 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:01.718769 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09161122-c4c5-4b0f-a503-b4aebf51bb38 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 200 len: 1224 microversion: 2.1 time: 0.110972 Oct 03 16:05:01.719492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 378/729] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:01 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:01.731369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-08de6401-e9de-4714-ac2c-1a5738cc9d24 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: .version_select at 0x7f8174b71ee0>, body: {"keypair": {"name": "tempest-keypair-934826114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnqGeM9nUW+b3tvKyhOfvHBuS1HrIXkki8n9o3KZUmXEflPKSp+xjWwdKWwVcSTrxb5gaXcmHRnXmugRJNdKQpKZQSgYtJKGmBYqSZSjMg0L+VW3/HSTxTC5JcJoOfhTA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:01.738535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:01.756628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-08de6401-e9de-4714-ac2c-1a5738cc9d24 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:05:01.761393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-08de6401-e9de-4714-ac2c-1a5738cc9d24 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:05:01.792171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-08de6401-e9de-4714-ac2c-1a5738cc9d24 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220489 Oct 03 16:05:01.799164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 352/730] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:05:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:05:02.632317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:02.633815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:02.641149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:02.641736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:02.642279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:02.643081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:02.643638 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:02.644266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:02.742973 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:02.744240 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:02.751934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:02.752707 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:02.753559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:02.755004 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:02.755640 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:02.756480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:02.770402 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] HTTP exception thrown: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Request method failure captured: Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec HTTP/1.1 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwddEJDzmEWOJyfMNN273Qpb075UrY4AZbIEFVqr0loMqAIe8vwqLVAZSdlrUSBLwn8ixRrJlUViSzRlVxqmy5IgSHNngjF7eHSrhEMW1XeYnJm4MHQNQkuEx0A3inZ97_AqCFV-u7Bf_gf-JJeo2T4OD6zvry6P4VQ8qXzQoRGacTI Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:05:02.772078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732e98240b4797b941e57f6606e6c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-467882445 Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 7377a1bca391446eb36b2a3233a7d471 Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:05:02.773669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '2ee7b689-24a1-4318-b643-8e02216f7dec'} Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:02.774671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:05:02.777416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:02.779824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Returning 404 to user: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:02.779824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ee962ce-a656-4b6e-a5cd-fab6c9054070 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 404 len: 111 microversion: 2.1 time: 0.035809 Oct 03 16:05:02.781372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 353/731] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:02 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:02.897759 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1246748583", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215967939", "security_groups": [{"name": "tempest-secgroup-smoke-1333872185"}], "block_device_mapping_v2": [{"uuid": "c3dbb74a-5dfb-47ea-9bda-2c7ff08840c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "13403649-4ce4-4f7b-972e-1b4b67982742"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:02.966304 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:02.977328 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:02.985112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:02.986412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e9726a8-a184-4526-96c1-c2c355ac31fc tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.358831 Oct 03 16:05:02.989093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 379/732] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:02 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:05:03.121011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] validate_networks() for [('13403649-4ce4-4f7b-972e-1b4b67982742', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:05:03.488121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2019787267", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b5f831-720b-4bbf-8b1b-0fa2209326c5"}], "security_groups": [{"name": "tempest-securitygroup--2119116098"}], "key_name": "tempest-keypair-934826114", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:03.625550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] validate_networks() for [('87b5f831-720b-4bbf-8b1b-0fa2209326c5', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:05:03.833423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:05:03.834507 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:05:03.835188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:05:03.835817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:05:03.836434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:05:03.846645 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:03.848477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:03.849300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:03.850278 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:03.850971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:03.851492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:03.873478 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:05:03.877651 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for user 7377a1bca391446eb36b2a3233a7d471 and project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:05:03.949442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:05:03.954891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3dbb74a-5dfb-47ea-9bda-2c7ff08840c9',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:05:04.113153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-729e5c69-3c67-4364-85cf-b84bfb87f9bc tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.219839 Oct 03 16:05:04.115403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 354/733] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:05:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 16:05:04.123398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:04.124410 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:04.133002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:04.133763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:04.135587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:04.136866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:04.137628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:04.138208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:04.141544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:04.239316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:05:04.239827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:05:04.240188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:05:04.240588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:05:04.241026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:05:04.251807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:04.252359 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:04.261534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:04.262534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:04.263670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:04.264124 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:04.287509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:05:04.292567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:05:04.307302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:05:04.310330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:05:04.310528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:04.324329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:04.325796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:04.326949 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bdcbd79-eadb-4023-8edc-bbef225d2ece tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.210291 Oct 03 16:05:04.336781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 355/734] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:04 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:04.343945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc95c112-712a-4b9a-b351-519cba55f094 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:04.343945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc95c112-712a-4b9a-b351-519cba55f094 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:04.371211 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a0481ec-9f03-4f46-8595-7c2a7c2766e5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.887386 Oct 03 16:05:04.378385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 380/735] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:05:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 16:05:04.383846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48665c3b-f021-4bb7-aae9-8006cca04bbe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:04.384539 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48665c3b-f021-4bb7-aae9-8006cca04bbe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:04.430003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc95c112-712a-4b9a-b351-519cba55f094 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:04.438904 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc95c112-712a-4b9a-b351-519cba55f094 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1094 microversion: 2.1 time: 0.102616 Oct 03 16:05:04.440565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 356/736] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:04 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:04.460794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-48665c3b-f021-4bb7-aae9-8006cca04bbe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:04.469435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48665c3b-f021-4bb7-aae9-8006cca04bbe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1241 microversion: 2.1 time: 0.089341 Oct 03 16:05:04.470101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 381/737] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:04 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:05.355094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:05.355696 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:05.365093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.365572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.365995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.366719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.367163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.367577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.464143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:05.468571 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:05.476619 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.477832 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.484813 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.485844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.486556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.487248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.539822 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:05.547883 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:05.549336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:05.550483 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f6b12a8-4500-45ff-ab26-d12fd01b7601 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.199319 Oct 03 16:05:05.551035 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 357/738] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:05 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:05.555639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:05.556119 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:05.556746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:05.563087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.563575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.564000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.564312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-644d7357-a93a-419a-9092-a9b41bab3c35 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1192 microversion: 2.1 time: 0.104551 Oct 03 16:05:05.564677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:05.565056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 382/739] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:05 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:05.565265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:05.565994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:05.625956 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:05.634436 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cee3671-e47a-402d-9725-20ef4d0245bf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1237 microversion: 2.1 time: 0.082226 Oct 03 16:05:05.635006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 358/740] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:05 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:06.072415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:06.074733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:06.080561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.081066 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.081495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.082207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.082647 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.083062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.114247 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2ad0dbc-a6cb-4301-bcb6-4bdf6911163b tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Oct 03 16:05:06.114776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 383/741] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:05:06 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:06.125285 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:06.125785 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:06.131919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.132400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.132935 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.133628 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.134079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.134500 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.164526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ce273e2-5199-416e-b0d5-3724f65e888e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71" status: 200 len: 194 microversion: 2.1 time: 0.043163 Oct 03 16:05:06.165128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 359/742] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 16:05:06 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:06.587907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:06.588575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:06.588735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:06.589345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:06.596135 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.596303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.596910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.597159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.598209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.598666 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.598983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.599495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.599916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.600044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.600640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.601285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.687849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:06.701167 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-915d6f98-6b44-446a-94b2-e1cfb6365713 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1210 microversion: 2.1 time: 0.116554 Oct 03 16:05:06.702050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 360/743] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:06 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:06.709894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:06.710570 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:06.720380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.721636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.722082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.723675 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:06.724203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:06.725462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:06.810872 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:06.824396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40c57fb3-d5a8-47a6-89e3-b2337c6eb89d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1293 microversion: 2.1 time: 0.120580 Oct 03 16:05:06.840816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 361/744] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:06 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:06.841164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:06.849372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:06.850812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:06.851976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be7238f0-170a-4274-8ee4-993dace5fcc9 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.268710 Oct 03 16:05:06.852524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 384/745] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:06 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:07.596816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5adf5a59-4e4e-4610-96cf-68e822428e89"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:07.600527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:07.607113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.607593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.608151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:07.609080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.609530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.609943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:07.727288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:07.728356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:07.736210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.736985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.737605 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:07.739196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.739859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.740461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:07.927990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0f95a2c-49fe-4579-b6ff-f07d4d77c480 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "POST /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334968 Oct 03 16:05:07.934275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 362/746] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:05:07 2022] POST /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:07.947653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:07.948368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:07.967648 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.968345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.969489 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:07.970841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:07.973268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:07.973846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:08.152375 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:08.164396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b1822ef-25d3-4d45-8033-be29e366cf38 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1299 microversion: 2.1 time: 0.231902 Oct 03 16:05:08.166020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 363/747] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:07 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:08.188474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:08.191776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:08.202967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:08.203590 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:08.204152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:08.204998 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:08.205542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:08.206752 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:08.245476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:08.260006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac96b314-46ee-4da0-9ec1-8619a8389710 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.537940 Oct 03 16:05:08.273408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 385/748] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:07 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:08.280295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb09ecb-c4c2-442c-935c-61a82613b3a7", "tag": "daf87bb6-218f-4859-967c-bcf0cbc9dffe"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:08.290887 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:08.291560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:08.291986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:08.306014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] Creating event network-changed:daf87bb6-218f-4859-967c-bcf0cbc9dffe for instance beb09ecb-c4c2-442c-935c-61a82613b3a7 on hv-cinder-84456 Oct 03 16:05:08.311005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7fdec39a-d985-44c5-8577-937ff1a51cb1 req-70713f35-e087-4936-a4be-b664f25d0fb7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Oct 03 16:05:08.311598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 386/749] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:08.559672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:08.568598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:08.570073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:08.571242 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc83b243-63ca-4e4a-b3ee-2bf72b185087 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1740 microversion: 2.20 time: 0.404022 Oct 03 16:05:08.584922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 364/750] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:08 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:09.190363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:09.191285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:09.198071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.198729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.199289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.200081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.200631 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.201219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.288192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:09.289359 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:09.295177 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.295663 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.296101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.296896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.297350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.297778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.542945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:09.551365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6cd883a-fdce-4aaf-a03b-e80c3f22c25b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.365595 Oct 03 16:05:09.552024 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 387/751] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:09 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:09.591025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:09.598485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:09.599330 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:09.599459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d2727ac-ec3d-4700-b575-9b6fa1860976 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.315736 Oct 03 16:05:09.608887 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 365/752] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:09 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:09.609090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.609090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.609090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.609090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:09.609439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:09.609439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:09.847965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:09.859412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:09.861310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:09.862634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f4d2801-4f1c-49b3-97b4-c5cc2ede923b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1740 microversion: 2.20 time: 0.269245 Oct 03 16:05:09.863887 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 388/753] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:09 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:10.142219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3d4b57-0c64-40bb-8710-b8e721815147", "tag": "406bfa19-5892-4c1a-b4c3-d8446200dae5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:10.168573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.169085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.169510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.183006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] Creating event network-changed:406bfa19-5892-4c1a-b4c3-d8446200dae5 for instance 8c3d4b57-0c64-40bb-8710-b8e721815147 on hv-cinder-84456 Oct 03 16:05:10.188658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-585de29b-1d50-4553-a558-0ed21bff2c72 req-278276cd-a521-40fb-aed5-53fe75a3edd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118480 Oct 03 16:05:10.189588 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 366/754] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:10.574561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:10.575267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:10.582460 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.582953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.583380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.587461 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.588552 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.589273 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.626299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:10.626996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:10.642741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.643876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.645630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.646530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.646990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.647411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.820991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:10.830929 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44d70fce-2958-4dd6-b0ab-d22bf5a305f6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.260096 Oct 03 16:05:10.845465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:10.845915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 389/755] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:10 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:10.855849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2375253-80b0-4088-babe-c2306f4c3b53 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.235204 Oct 03 16:05:10.856751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 367/756] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:10 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:10.889954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:10.890834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:10.897428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.898102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.898532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:10.899559 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:10.900435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:10.901189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:11.051348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:11.061748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:11.063503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:11.064673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d0b30e6-424f-4e81-96a6-95e5d21a0095 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.178697 Oct 03 16:05:11.065797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 390/757] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:10 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:11.856109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:11.856712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:11.866644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:11.868100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:11.868735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:11.869608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:11.870223 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:11.871104 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:11.879102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:11.881031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:11.892613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:11.893369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:11.898588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:11.900047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:11.901556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:11.903844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:11.914402 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:12.250257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:12.256352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:12.261866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4981e22-64e9-47bf-8594-682e9cf971c3 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.386813 Oct 03 16:05:12.263257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 391/758] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:11 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:12.266575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3846494-f343-4c90-91f3-974ceb8e8918 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.414363 Oct 03 16:05:12.267304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 368/759] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:11 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:12.280834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:12.281637 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:12.289759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:12.290431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:12.291990 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:12.293216 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:12.293864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:12.294454 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:12.365446 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "name": "network-vif-plugged", "status": "completed", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:12.375721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:12.376474 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:12.377138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:12.389661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] Creating event network-vif-plugged:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:05:12.398201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d8efb4d1-85a6-4d47-8087-07645cc1d3ee req-bc137257-4405-4365-9fed-3dfd3196a202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127671 Oct 03 16:05:12.398811 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 369/760] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:12.568126 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:12.579887 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:12.582755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:12.584069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbcc0f1a-ae86-4d9a-83b7-eec2c6cb058e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.319614 Oct 03 16:05:12.584544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 392/761] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:12 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:13.287206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:13.288518 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:13.290954 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:13.292145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:13.295940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.296424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.296889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.297796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.298253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.298860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.299320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.300753 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.301285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.302103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.302667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.303442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.537900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:13.557039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:13.559799 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0a60d8e-2fd8-4ba4-9961-1e7d2e63e6ad tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.277540 Oct 03 16:05:13.563343 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 370/762] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:13 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:13.564762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11afdb7d-5c62-45c5-9ef1-26019f9e5ec5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.277966 Oct 03 16:05:13.565320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 393/763] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:13 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:13.611545 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:13.612300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:13.619394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.620111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.620713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.621648 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:13.622103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:13.622526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:13.774273 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:13.784037 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:13.786631 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:13.788054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd16e7b9-7e12-4ff3-9740-e55c52bc407b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.180493 Oct 03 16:05:13.792771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 371/764] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:13 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:14.585202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:14.586874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:14.589266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:14.590009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:14.591029 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:14.591642 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:14.595516 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:14.597945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:14.599984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.601141 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.601788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:14.602727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.602896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.603224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.603663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:14.603862 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.604368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.604754 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:14.604874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.605267 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:14.841889 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:14.846642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:14.849599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:14.855090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19b84f24-8d0b-4fd1-b7b3-bf9432279929 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.270622 Oct 03 16:05:14.860763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 394/765] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:14 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:14.860937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74969662-7fb4-4b62-9c5d-68329a2a6654 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.272357 Oct 03 16:05:14.860937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 372/766] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:14 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:14.871139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:14.872616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:14.880069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.880513 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.881058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:14.881993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:14.882687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:14.883033 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.026155 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:15.044037 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:15.045524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:15.046712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8717abbd-791d-444e-9c8b-5c62b0f09ab3 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.189661 Oct 03 16:05:15.047715 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 395/767] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:14 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:15.665782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:15.668304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:15.679981 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.680794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.681396 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.682272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.682735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.683165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.725072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed71f07e-aa43-4925-addc-8f0d57c3fb9e tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064090 Oct 03 16:05:15.725889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 373/768] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:05:15 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:15.880152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:15.880653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:15.880981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:15.882464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:15.889553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.890404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.891129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.892374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.893075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.893616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.894019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.894373 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.897125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.898080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.901035 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.901503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.957292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7324423-e47a-48be-89db-97c3932090a2 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71" status: 200 len: 194 microversion: 2.1 time: 0.081324 Oct 03 16:05:15.957924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 374/769] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 16:05:15 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:15.957924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:15.957924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:15.973097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.973487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.974117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:15.974832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:15.975291 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:15.975719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.131750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:16.144023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-242bb53b-586b-4168-be0c-e3868cca8ace tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.268127 Oct 03 16:05:16.144846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 396/770] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:15 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:16.155288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:16.155622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:16.165080 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:16.165290 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:16.165702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.166797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:16.166931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:16.167250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.195459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:16.204047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0acb9c93-3972-4da5-bc36-73cbbcd4339e tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.244642 Oct 03 16:05:16.205406 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 375/771] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:15 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:16.210630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:16.211219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:16.217548 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:16.218061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:16.218492 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.219189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:16.219639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:16.220061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.271332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'services' on Instance uuid 52e40c96-5f19-40a7-be49-dd0c05c3c343 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:05:16.376767 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:16.379920 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:16.381454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:16.382757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c1649af-f5f2-429a-a08d-70b325b2f50b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.176342 Oct 03 16:05:16.383513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 376/772] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:16 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:16.385866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e360e54a-70fa-4e94-84c3-4128ac178ba4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71" status: 202 len: 0 microversion: 2.1 time: 0.239736 Oct 03 16:05:16.386721 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 397/773] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:05:16 2022] DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/4aebc1a0-3fdd-4df9-8c2f-25cbdb3b5a71 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:05:16.388100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d4b57-0c64-40bb-8710-b8e721815147", "name": "network-vif-plugged", "status": "completed", "tag": "406bfa19-5892-4c1a-b4c3-d8446200dae5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:16.398047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:16.398583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:16.399068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:16.412062 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] Creating event network-vif-plugged:406bfa19-5892-4c1a-b4c3-d8446200dae5 for instance 8c3d4b57-0c64-40bb-8710-b8e721815147 on hv-cinder-84456 Oct 03 16:05:16.417413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d6cbea83-d8f0-4c87-a815-867aabea7c3d req-65477d38-c388-450e-94ed-50275af5f923 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Oct 03 16:05:16.418083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 377/774] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:17.171955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:17.172663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:17.179873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.180411 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.180820 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.181572 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.182027 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.182513 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.229622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:17.230433 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:17.241290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.242235 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.242860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.243965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.244586 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.245243 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.730389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.742789 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c5871a2-7eac-4658-b791-b4432497e591 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.518519 Oct 03 16:05:17.745980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.751972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 378/775] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:17 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:17.758648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b93dcb6-74db-441c-9010-5d8a35fff707 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.591176 Oct 03 16:05:17.770966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:17.770966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:17.770966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.770966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.771383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.771383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.771383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.771383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.772883 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 398/776] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:17 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:17.915836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.927411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.929326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.930780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7be24aa5-02f0-41f0-8429-a6a08bba9867 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.177800 Oct 03 16:05:17.949655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 379/777] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:17 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:18.695873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.696443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.703161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.703871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.704315 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.705042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.705845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.706817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.739582 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1ec550d-2547-4f2e-afa8-80e4837e636d tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/5adf5a59-4e4e-4610-96cf-68e822428e89" status: 200 len: 194 microversion: 2.1 time: 0.047615 Oct 03 16:05:18.745421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 399/778] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Oct 3 16:05:18 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/5adf5a59-4e4e-4610-96cf-68e822428e89 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:18.750889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.751371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.759644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.760216 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.760739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.761702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.762222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.762846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.771762 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.772841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.782440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.784357 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.785036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.786300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.787019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.787451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.860040 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'services' on Instance uuid 52e40c96-5f19-40a7-be49-dd0c05c3c343 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:05:18.958689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:18.958867 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6bc8f50-a504-438e-90e5-ae37a22412d5 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/5adf5a59-4e4e-4610-96cf-68e822428e89" status: 202 len: 0 microversion: 2.1 time: 0.211478 Oct 03 16:05:18.959451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 380/779] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:05:18 2022] DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments/5adf5a59-4e4e-4610-96cf-68e822428e89 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:05:18.965970 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.966957 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.977403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.978612 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.979285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26400376-d09b-4a5d-9aa0-f76e31901be7 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.213810 Oct 03 16:05:18.979526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.980470 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.981160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 400/780] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:18 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:18.981542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.982202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.988379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.989234 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.997209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.998088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.998730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.999575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:19.000169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:19.001276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:19.233980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:19.238790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:19.244576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81b82ad4-08ea-435a-8456-2cf3194543c0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1367 microversion: 2.1 time: 0.283453 Oct 03 16:05:19.250174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:19.252564 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:19.254285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f93177c-797b-4968-94f7-a6eb5c2512ec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.271868 Oct 03 16:05:19.269044 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 401/781] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:18 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:19.269236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 381/782] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:18 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:20.005317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:20.006082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:20.018807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.020566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.021154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.022875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.024576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.025707 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.107096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb09ecb-c4c2-442c-935c-61a82613b3a7", "name": "network-vif-plugged", "status": "completed", "tag": "daf87bb6-218f-4859-967c-bcf0cbc9dffe"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:20.136662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.137088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.137525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.163048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] Creating event network-vif-plugged:daf87bb6-218f-4859-967c-bcf0cbc9dffe for instance beb09ecb-c4c2-442c-935c-61a82613b3a7 on hv-cinder-84456 Oct 03 16:05:20.174023 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1ccc214f-9b23-454f-b7a5-951884e4d030 req-2d457393-0305-4563-8726-6956eb485268 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071730 Oct 03 16:05:20.177057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 382/783] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:05:20.228486 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.243327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5defd88-0217-49b2-be3d-7dec16f3c89b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.243345 Oct 03 16:05:20.244055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 402/784] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:19 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:20.267756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:20.268466 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:20.276433 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.276940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.277366 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.278308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.278962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.279600 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.290139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:20.290362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:20.310266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.310779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.311196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.311903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.312354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.323953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.552186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.560461 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3ac14cb-1933-445b-9ca1-a8384bac4f53 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1556 microversion: 2.1 time: 0.296842 Oct 03 16:05:20.572892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 383/785] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:20 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1556 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:20.585517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:20.586018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:20.592257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.593096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.593735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.594664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.595328 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.595958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.606015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.614525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.616170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.617383 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f864c394-eebd-4cdb-b894-8163c5103356 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1735 microversion: 2.20 time: 0.341954 Oct 03 16:05:20.617945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 403/786] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:20 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:20.677254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec671f0d-ba5a-489b-87e7-c43b68b60079 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097406 Oct 03 16:05:20.678010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 384/787] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:05:20 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:05:21.250854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.254285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.260662 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.267611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.268222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.272699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.273182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.273919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.274379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.274801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.276940 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.277424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.277853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.279701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.279701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.279701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.307471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-195cd256-af20-4e76-928e-1e831a9907e8 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060644 Oct 03 16:05:21.308229 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 404/788] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 16:05:21.432680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.434856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.441435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.441922 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.442358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.443057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.443520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.443947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.473514 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79151699-d69b-407d-8d91-eca708226ea4 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044703 Oct 03 16:05:21.474082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 405/789] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 16:05:21.520784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.529905 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63668d94-22e1-429a-9cfa-f8d124f6bd7d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1266 microversion: 2.1 time: 0.266370 Oct 03 16:05:21.541668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 385/790] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:21.546518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.547297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.553989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.554479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.554912 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.555838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.556317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.556812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.583071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:05:21.597945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:21.644100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.644855 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.651247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.651731 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.652344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.653251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.653898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.654311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.669174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91436b6d-4022-4d88-911d-9371de22b21a tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 204 len: 0 microversion: 2.1 time: 0.126514 Oct 03 16:05:21.673694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 406/791] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:05:21 2022] DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 16:05:21.681706 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.682420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.688999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.689321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.689804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.692049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.692518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.693006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.870574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.879808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.882913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.884150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e75ab217-d12d-4dbd-9473-8964e304da84 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1717 microversion: 2.20 time: 0.244464 Oct 03 16:05:21.884711 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 386/792] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:21.894964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3d4b57-0c64-40bb-8710-b8e721815147", "tag": "406bfa19-5892-4c1a-b4c3-d8446200dae5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:21.902370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.911943 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e831154-0c69-465b-bd06-c3ebf3b8ca81 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1672 microversion: 2.1 time: 0.236963 Oct 03 16:05:21.913603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.914269 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.914854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.925626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 407/793] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:21.927303 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] Creating event network-changed:406bfa19-5892-4c1a-b4c3-d8446200dae5 for instance 8c3d4b57-0c64-40bb-8710-b8e721815147 on hv-cinder-84456 Oct 03 16:05:21.932422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1375e3d1-ac90-406e-af66-ca7e99aa9f21 req-63ff5f4b-69f5-46a4-87c0-cab43bad7c22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041997 Oct 03 16:05:21.933335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 387/794] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:22.553886 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:22.554498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:22.560937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.561414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.561845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.562528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.562980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.563401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.699415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:22.708567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e2aa52c-fee6-496d-b045-33add8811e6f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1452 microversion: 2.1 time: 0.158612 Oct 03 16:05:22.709266 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 408/795] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:22 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:22.732453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:22.733188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:22.735179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:22.741057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.741548 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.741979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.742700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.743149 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.743569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.881918 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:22.889681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fbabb38-9c36-4aac-926e-e4f32ad45668 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1452 microversion: 2.1 time: 0.161987 Oct 03 16:05:22.890246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 388/796] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:22 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:22.911812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:22.912420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:22.921309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.922002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.922609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.923474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.924109 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.924527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.938079 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:22.938951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:22.945691 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.946163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.946769 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.947733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.948069 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.948490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:23.223439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:23.232114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:23.232969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:23.233619 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:23.235452 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f993ff41-6855-4157-87fe-c92bcc969a76 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1717 microversion: 2.20 time: 0.328569 Oct 03 16:05:23.236465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 409/797] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:22 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1717 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:23.246915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34799bb9-e5aa-4dd3-acc7-8763cf9cd087 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1672 microversion: 2.1 time: 0.312994 Oct 03 16:05:23.247725 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 389/798] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:22 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1672 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:24.281552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:24.282503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:24.283092 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:24.283603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:24.287916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:24.292781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.299952 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.302744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.307165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.308064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.308889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.309423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.309991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.313342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.314371 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.315056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.320600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.837162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:24.846859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:24.848231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de072e34-9c00-41c0-a792-17ee3790b858 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1672 microversion: 2.1 time: 0.570031 Oct 03 16:05:24.849463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 390/799] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:24 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1672 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:24.869200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:24.870835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:24.872130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b0a8088-4afb-4f4a-b217-6e44eb00a44b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1717 microversion: 2.20 time: 0.599755 Oct 03 16:05:24.890920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 410/800] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:24 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:25.056122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e40c96-5f19-40a7-be49-dd0c05c3c343", "name": "network-vif-deleted", "tag": "cf761e51-dba3-432f-af44-45799f73b23a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:25.094820 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.095549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.101339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.104379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:25.118434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] Creating event network-vif-deleted:cf761e51-dba3-432f-af44-45799f73b23a for instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 on hv-cinder-84456 Oct 03 16:05:25.125305 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-19b3383c-8ecb-4fe1-bb91-f0c71eaf6a50 req-dc98d10e-fa07-4888-9da4-bcf91ece082e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095786 Oct 03 16:05:25.126813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 391/801] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:25.873003 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:25.874403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:25.882205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.882884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.883491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.884525 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.885188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.885771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.901367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:25.902339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:25.919712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.920772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.921785 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.923168 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.924005 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.928690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.942969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:25.943723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:25.944323 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:25.944981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid 52e40c96-5f19-40a7-be49-dd0c05c3c343 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:05:25.993976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:26.004626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-392d897c-b7ca-4329-9fab-de0db45c8833 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1328 microversion: 2.1 time: 0.135891 Oct 03 16:05:26.019741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 411/802] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:25 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:26.019741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb09ecb-c4c2-442c-935c-61a82613b3a7", "tag": "daf87bb6-218f-4859-967c-bcf0cbc9dffe"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:26.023778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:26.025791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:26.026548 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:26.041005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] Creating event network-changed:daf87bb6-218f-4859-967c-bcf0cbc9dffe for instance beb09ecb-c4c2-442c-935c-61a82613b3a7 on hv-cinder-84456 Oct 03 16:05:26.047816 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0a426b0c-d34e-4d5b-aa1d-5321db2d9a9f req-2c62050a-7b3d-46e3-b8a5-ad7255ec2508 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040716 Oct 03 16:05:26.048609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 412/803] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:26.164175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "name": "network-vif-unplugged", "status": "completed", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:26.173796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:26.175026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:26.175615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:26.188129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] Creating event network-vif-unplugged:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:05:26.193646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e2e09f82-7de7-49db-bd77-9c586a446fe8 req-5a12aebe-71fd-424d-8e74-a693e5bbe1b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033507 Oct 03 16:05:26.194307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 413/804] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:05:26.296622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:26.306172 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:26.307725 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:26.309010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21fcc2ba-4767-4d03-921d-119e7d11b11a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1717 microversion: 2.20 time: 0.412440 Oct 03 16:05:26.309772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 392/805] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:25 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1717 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:27.036676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:27.037439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:27.043696 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.044425 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.044908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.045606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.046059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.046498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.077515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.077991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.078422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.078857 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lazy-loading 'fault' on Instance uuid 52e40c96-5f19-40a7-be49-dd0c05c3c343 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:05:27.133321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a1aa0996db4c8ea851b2ba45026b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8db1f811cf84507ad7ea7058d6a0d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:27.142545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb3a8f84-e684-4d3a-8813-ff9ed828aafe tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 200 len: 1328 microversion: 2.1 time: 0.114405 Oct 03 16:05:27.144044 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 414/806] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:27 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:27.338233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:27.339397 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:27.346830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.348519 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.348990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.349710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.350162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.350726 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.695158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:27.703562 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:27.705450 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:27.707201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c861eb8-11d4-4b0f-a4c9-4b16efed9a59 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1720 microversion: 2.20 time: 0.373302 Oct 03 16:05:27.707782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 393/807] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:27 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:27.733688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccca328f-c428-4454-8656-c07422a267a5"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:27.735985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:27.742739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.743215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.743640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:27.744321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:27.744979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:27.745405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.041908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7ac907a-1420-4868-9ec7-143b90533e89 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312130 Oct 03 16:05:28.047825 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 415/808] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Oct 3 16:05:27 2022] POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 16:05:28.166211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:28.166718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:28.169790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:28.170393 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:28.172644 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.173183 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.173619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.174314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.175475 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.175908 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.177059 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.177583 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.177929 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.178615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.179057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.179472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.192701 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 HTTP/1.1 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:05:28.194378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:28.196040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '52e40c96-5f19-40a7-be49-dd0c05c3c343'} Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:28.196994 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:28.198515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:28.200079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:28.200079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa4b5845-74cf-4fc2-9f2f-b7057e15c911 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 404 len: 111 microversion: 2.1 time: 0.029849 Oct 03 16:05:28.200079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 416/809] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:28 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:05:28.204157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1aa8432-0c7b-4e88-a049-2681b0cff5c6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '.version_select at 0x7f81784905e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:28.226913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1aa8432-0c7b-4e88-a049-2681b0cff5c6 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744475952" status: 202 len: 0 microversion: 2.1 time: 0.026166 Oct 03 16:05:28.227472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 417/810] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Oct 3 16:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744475952 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:05:28.428121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24fb1594-6709-43c9-99e5-b26b8a780f09 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments/ccca328f-c428-4454-8656-c07422a267a5" status: 202 len: 0 microversion: 2.20 time: 0.265798 Oct 03 16:05:28.428920 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 394/811] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Oct 3 16:05:28 2022] DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments/ccca328f-c428-4454-8656-c07422a267a5 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:05:28.493144 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:28.493731 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:28.503174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.503791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.504321 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.505049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.505496 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.505915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.550644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 16:05:28.621322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-148a871d-e794-4572-9ea2-50ccc52afa22 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/action" status: 202 len: 0 microversion: 2.20 time: 0.131598 Oct 03 16:05:28.622462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 418/812] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Oct 3 16:05:28 2022] POST /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:05:28.631177 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:28.631784 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:28.638586 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.639055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.639669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.640537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:28.641305 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:28.641807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:28.786135 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:28.794892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:28.796442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:28.797812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf1127a1-03cd-4b7d-a713-eb72724763a2 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1668 microversion: 2.20 time: 0.171243 Oct 03 16:05:28.798471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 395/813] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:28 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:29.824000 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:29.824611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:29.830997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:29.831754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:29.832196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:29.832920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:29.833370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:29.833788 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:30.041993 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:30.051055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:30.055534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:30.057966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b93fdc6d-10a4-4d2d-94e8-53810f15fd55 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.238405 Oct 03 16:05:30.058532 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 419/814] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:29 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:31.084056 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:31.084655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:31.091452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.091917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.092351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.093083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.093539 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.093961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.237448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:31.248559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:31.257486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:31.258557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:31.259099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:31.259730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec95b1e9-3d5d-49bf-ba20-d4af99670a16 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.179880 Oct 03 16:05:31.261085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 396/815] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:31 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:05:31.267111 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.268068 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.269120 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.270697 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.271814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.273048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.308374 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 HTTP/1.1 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:05:31.310955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.312225 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '52e40c96-5f19-40a7-be49-dd0c05c3c343'} Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:31.313119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.314294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.316271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:31.316271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ebd9e02-fcad-4ee0-a1f3-e3ba8607fc13 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 404 len: 111 microversion: 2.1 time: 0.057876 Oct 03 16:05:31.316271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 420/816] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:05:31 2022] DELETE /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:31.325650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:31.326517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: 52e40c96-5f19-40a7-be49-dd0c05c3c343] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:31.334301 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.334596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.334998 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.335936 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:31.342305 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:31.343125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:31.364780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 HTTP/1.1 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:05:31.366616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.368144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '52e40c96-5f19-40a7-be49-dd0c05c3c343'} Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:31.369060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. Oct 03 16:05:31.370621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:31.371906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance 52e40c96-5f19-40a7-be49-dd0c05c3c343 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:31.371906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-deafccb8-22bc-4dd7-b93c-8675ee89bc64 tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343" status: 404 len: 111 microversion: 2.1 time: 0.048592 Oct 03 16:05:31.371906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 397/817] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:31 2022] GET /compute/v2.1/servers/52e40c96-5f19-40a7-be49-dd0c05c3c343 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:05:32.301367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:32.301884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:32.308793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.309286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.309720 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.310422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.310875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.311295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.331118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:32.454087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:32.463013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:32.464466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:32.465699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-926e6452-ca6d-4aae-a8c8-6a79f203ea13 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.169053 Oct 03 16:05:32.466250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 421/818] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:32 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:32.527315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:32.528751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:32.536252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.536754 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.537199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.537925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.538382 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.538907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.556386 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e HTTP/1.1 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:05:32.557919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.559615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'e7a24b8d-f733-4d00-8cbd-5f211f9ef68e'} Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:32.560423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.561744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.563050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:32.563050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87a7e087-089a-4ecc-9b32-0d1833a5762f tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 404 len: 111 microversion: 2.1 time: 0.035983 Oct 03 16:05:32.563050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 398/819] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:05:32 2022] DELETE /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:32.568294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:32.568949 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] [instance: e7a24b8d-f733-4d00-8cbd-5f211f9ef68e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:32.575325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.575819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.576257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.577049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:32.577757 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:32.578426 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:32.594013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] HTTP exception thrown: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Request method failure captured: Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e HTTP/1.1 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbTZEc_HFHoZd5lYlV8YsUVG_Sp1VGDqkDzsCwXcYoKs_HBRIc7kqRwZu5b8k3za2xcS1MCDZeWKRI2HGbrYjJFu6RNK3TKU4XpevGEfijUBEMRGVr8pQoSDsG7g_rp8vCnwnxVXeKIiahWZM48snVqzw4k9s3fs41Fa0SsI37hxh0 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:05:32.596495 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8db1f811cf84507ad7ea7058d6a0d25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8db1f811cf84507ad7ea7058d6a0d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: a8db1f811cf84507ad7ea7058d6a0d25 Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459047888 Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 73a1aa0996db4c8ea851b2ba45026b35 Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-1459047888-project Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.598091 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'e7a24b8d-f733-4d00-8cbd-5f211f9ef68e'} Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:32.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. Oct 03 16:05:32.600094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:32.601190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] Returning 404 to user: Instance e7a24b8d-f733-4d00-8cbd-5f211f9ef68e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:32.601190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23e61694-940c-4ad9-a4c8-14a8153e4bfd tempest-AttachVolumeTestJSON-1459047888 tempest-AttachVolumeTestJSON-1459047888-project] 10.222.0.33 "GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e" status: 404 len: 111 microversion: 2.1 time: 0.033788 Oct 03 16:05:32.601190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 422/820] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:32 2022] GET /compute/v2.1/servers/e7a24b8d-f733-4d00-8cbd-5f211f9ef68e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:33.491813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:33.492810 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:33.499178 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:33.499750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:33.500268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:33.501100 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:33.501641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:33.502127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:33.663671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:33.672881 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:33.674939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:33.676831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3369abfb-09b0-45f0-a8e3-084721ae7f69 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.188834 Oct 03 16:05:33.678096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 399/821] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:33 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:34.707358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:34.708528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:34.715858 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:34.729376 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:34.730189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:34.731536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:34.732545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:34.733353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:34.954169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:34.965723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:34.967520 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:34.968859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1db3c3a1-396c-41c5-bf3c-f1e3273e288f tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.265891 Oct 03 16:05:34.970072 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 423/822] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:34 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:35.998023 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:35.999230 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:36.012968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:36.013790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:36.014406 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:36.015347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:36.016430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:36.017229 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:36.308350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:36.326227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:36.327989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:36.329792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d429914-06f0-413a-ad5e-61b7af1e81b4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.336993 Oct 03 16:05:36.335170 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 400/823] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:35 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:37.369948 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:37.371283 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:37.379285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:37.380274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:37.381301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:37.382792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:37.383440 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:37.384030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:37.559298 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:37.574380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:37.575827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:37.577017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5cab655d-3448-488f-9ed7-d1196c815704 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.215710 Oct 03 16:05:37.577556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 424/824] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:37 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:38.603326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:38.604041 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:38.623699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:38.625988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:38.626503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:38.628012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:38.630281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:38.631618 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:38.829121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:38.839543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:38.841627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:38.843173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-984ebae6-c6b8-47b7-857f-d2fe71c8ae0c tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.244016 Oct 03 16:05:38.844259 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 401/825] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:38 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:39.878067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:39.878829 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:39.885600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:39.886089 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:39.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:39.887228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:39.887687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:39.888110 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:40.023673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:40.033048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:40.035047 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:40.036205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b24d904d-08b6-4e4e-b611-c64ef3e20f06 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.162879 Oct 03 16:05:40.036974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 425/826] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:39 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:41.063095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:41.064151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:41.071494 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:41.071986 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:41.072422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:41.073388 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:41.073849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:41.074281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:41.216955 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:41.226576 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:41.228027 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:41.229233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a35358d-23b8-42fa-b32c-a659c64d7f70 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.170949 Oct 03 16:05:41.230428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 402/827] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:41 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:42.255747 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:42.256355 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:42.262819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:42.263295 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:42.263724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:42.264406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:42.264881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:42.265522 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:42.401730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:42.411113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:42.412556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:42.413738 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-12b0ea62-4ac4-4c4f-838e-d0e9f0950a92 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.162240 Oct 03 16:05:42.414291 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 426/828] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:42 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:43.441261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:43.442069 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:43.449119 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:43.449610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:43.450204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:43.450878 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:43.451353 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:43.451777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:43.588341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:43.597317 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:43.598938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:43.600188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-045e4ce5-bfde-4422-b1b5-046a26f5bd5b tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.164106 Oct 03 16:05:43.600736 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 403/829] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:43 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:44.628251 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:44.629254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:44.635786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:44.636274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:44.636726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:44.637497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:44.637961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:44.638372 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:44.777919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:44.792497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:44.794063 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:44.795308 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d2ab9c6-8400-4c0f-9ec7-70159bde3e6d tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.172476 Oct 03 16:05:44.795952 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 427/830] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:44 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:45.826898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:45.827510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:45.835016 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:45.835523 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:45.835954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:45.836638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:45.837375 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:45.837797 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:45.965252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:45.974704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:45.976139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:45.977329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b188496-360e-440d-b815-ceab5c5a75e6 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.154376 Oct 03 16:05:45.977881 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 404/831] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:45 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:05:46.154559 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "name": "network-vif-plugged", "status": "completed", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:46.181401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:46.181876 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:46.199036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:46.219302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] Creating event network-vif-plugged:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:05:46.234337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d389afda-964b-43fa-a40f-27e65347474e req-c0b512d3-c340-4277-9096-5058ae78e828 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084471 Oct 03 16:05:46.239296 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 428/832] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:47.002984 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:47.004231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:47.010719 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.011200 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.011721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.012601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.013077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.013495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.041491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:47.042077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:47.049084 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.050471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.050911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.051614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.052069 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.052492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.080600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:05:47.156371 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:47.165901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:47.167592 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:47.169207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc2ffb2e-fa6f-4917-bdd2-44a10408e055 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.170140 Oct 03 16:05:47.170173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 405/833] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:46 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:47.176918 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:47.183942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23d5a6c6-bca8-440c-929b-e91a5705e90d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 204 len: 0 microversion: 2.1 time: 0.147380 Oct 03 16:05:47.185786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 429/834] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:05:47 2022] DELETE /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:05:47.186964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.187456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.187866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.195452 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:47.196309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:47.201203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] Creating event network-changed:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:05:47.202781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.203363 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.203917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.205657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:47.205819 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:47.206344 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:47.207103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dcf01ebd-b6b9-4047-a587-53392c260a76 req-e9c13b64-03a1-4e77-8240-268d4ac29f39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034877 Oct 03 16:05:47.207880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 406/835] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:47.397856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:47.405820 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e4a7b78-451b-4d9f-8e24-484d6cc8ed91 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.215568 Oct 03 16:05:47.406394 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 430/836] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:47 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:48.200948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:48.201637 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:48.208174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:48.208642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:48.209101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:48.209782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:48.210226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:48.210641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:48.343188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:48.347559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:48.352969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:48.354398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:48.355546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f8d5920-2111-4b2f-9ac2-7bb833179373 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.159399 Oct 03 16:05:48.356095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 407/837] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:48 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 16:05:48.430134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:48.430748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:48.437163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:48.437643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:48.438076 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:48.438759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:48.439277 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:48.439699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:48.572147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:48.580661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66b068bf-f0e5-4e54-a008-dd787911764d tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.153683 Oct 03 16:05:48.581256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 431/838] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:48 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:49.381987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:49.382589 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:49.389463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.389937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.390362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.391039 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.391483 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.391898 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.527571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:49.537077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:49.538684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:49.540236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26d217c8-e102-4d21-9d1c-040e28e96096 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1726 microversion: 2.20 time: 0.162928 Oct 03 16:05:49.541141 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 408/839] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:49 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:49.604133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:49.604743 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:49.611245 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.611731 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.612159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.612870 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.613317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.613721 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.920884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:49.929209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1f661e4-f003-462e-994d-8a76db7ab527 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1567 microversion: 2.1 time: 0.329031 Oct 03 16:05:49.929777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 432/840] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:49 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:05:50.255178 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb", "name": "network-vif-deleted", "tag": "34bfb794-30e4-4270-b51b-d7639fa10284"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:50.267281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.267932 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.268431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.280907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] Creating event network-vif-deleted:34bfb794-30e4-4270-b51b-d7639fa10284 for instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb on hv-cinder-84456 Oct 03 16:05:50.286221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1a9ba55a-1354-4ead-b849-02112ad1e622 req-71011561-792f-448b-b9f1-3af4ef0cbb47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036555 Oct 03 16:05:50.287182 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 409/841] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:50.566899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:50.567614 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:50.574200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.574721 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.575209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.575911 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.576385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.576808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.726090 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:50.736023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:50.738354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:50.739652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0daf85d6-8fc1-484a-9ba9-86824303815e tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1713 microversion: 2.20 time: 0.177135 Oct 03 16:05:50.740215 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 433/842] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:05:50 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1713 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:05:50.952369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:50.953086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:50.960208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.960684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.961177 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.962121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.962572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.962988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.993209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.993673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.994097 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.994528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lazy-loading 'fault' on Instance uuid ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:05:51.039175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950e06d7bfff4259972ae1312e8f913a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b016d4443142d4bb81dae536748cf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:51.047287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c851d0a-9a15-43b9-8a56-c5aae69dffbf tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 200 len: 1223 microversion: 2.1 time: 0.099080 Oct 03 16:05:51.047845 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 410/843] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:50 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:52.071624 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:52.072232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] [instance: ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:52.078694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:52.079179 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:52.079609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:52.081490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:52.081945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:52.082368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:52.096672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] HTTP exception thrown: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Request method failure captured: Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb HTTP/1.1 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwcLDb9cAxFPl_7rCtjD7V73kfgu51K6xgVXVSV_rgyL8o9vJzvXIG10UfQqY4L-AXOqH6zEbXYz-0KmItfelK5ZBAegLSOYXhjZ6nbNYXgP380k1ZAkNCb3zxF8p_ue3aLPGlIiqy2_y7zY2hZNkhKFuywbXZqZyYUIE17PE3ZT8r8 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 60b016d4443142d4bb81dae536748cf1 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestShelveInstance-278066694 Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:05:52.098335 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60b016d4443142d4bb81dae536748cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60b016d4443142d4bb81dae536748cf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60b016d4443142d4bb81dae536748cf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60b016d4443142d4bb81dae536748cf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestShelveInstance-278066694 Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 60b016d4443142d4bb81dae536748cf1 Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestShelveInstance-278066694 Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestShelveInstance-278066694-project Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 950e06d7bfff4259972ae1312e8f913a Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestShelveInstance-278066694-project Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. Oct 03 16:05:52.099931 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb'} Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:52.100984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. Oct 03 16:05:52.102470 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:05:52.103840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Returning 404 to user: Instance ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:52.103840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a48942c1-927f-47a5-a798-3878b4f60a75 tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb" status: 404 len: 111 microversion: 2.1 time: 0.032184 Oct 03 16:05:52.103840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 434/844] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:52 2022] GET /compute/v2.1/servers/ad7fa81a-ddc8-4ef9-9a59-25fc5d97b7cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:52.266421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8641a4e8-20f4-41ef-a0f5-0cabd51d90cb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] Calling method '.version_select at 0x7f8174d28280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:52.287514 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8641a4e8-20f4-41ef-a0f5-0cabd51d90cb tempest-TestShelveInstance-278066694 tempest-TestShelveInstance-278066694-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036203080" status: 202 len: 0 microversion: 2.1 time: 0.024904 Oct 03 16:05:52.288595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 411/845] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Oct 3 16:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036203080 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:05:57.845784 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:57.846362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:57.848872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:57.854025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:57.854498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:57.854930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:57.855613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:57.856057 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:57.856509 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:57.882411 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1c8a6fd7-a572-4fb9-a071-1f4f491c68e3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/ips" status: 200 len: 148 microversion: 2.1 time: 0.041119 Oct 03 16:05:57.882915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 435/846] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:05:57 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:59.299253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aee80fa0-553c-45ba-b1b1-789f617f7aca"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:59.302175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:59.304636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:59.320017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.320519 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.320994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:59.321700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.322138 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.322559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:59.599431 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7836c20-5536-4f9a-a034-8d2ad4a4dcc6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305798 Oct 03 16:05:59.600128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 412/847] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:05:59 2022] POST /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:09.310112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-698f942f-f420-4c80-93f0-90e857d05170 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: .version_select at 0x7f817849c040>, body: {"keypair": {"name": "tempest-keypair-166469587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhO97WL6bfzYFTsAv82nnBiO6edvK4o1Kh+QpzpL1YtFTYsCNIOO9f/en2AdV0Fpxqt6RzHxPyU5RsM5gZvFtWdk77bIclVXqBCLC8OGnRObOoSYyE3T3JEKLr1honRAA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:09.316636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:09.317538 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:09.331380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-698f942f-f420-4c80-93f0-90e857d05170 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:06:09.335409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-698f942f-f420-4c80-93f0-90e857d05170 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:06:09.357652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-698f942f-f420-4c80-93f0-90e857d05170 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051386 Oct 03 16:06:09.358173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 436/848] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:06:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:10.667938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:10.668704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:10.673648 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818686749", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b5f831-720b-4bbf-8b1b-0fa2209326c5"}], "security_groups": [{"name": "tempest-securitygroup--1753963395"}], "key_name": "tempest-keypair-166469587", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:10.789193 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] validate_networks() for [('87b5f831-720b-4bbf-8b1b-0fa2209326c5', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:06:11.274250 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:06:11.274758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:06:11.275742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:06:11.276112 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:06:11.277534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:06:11.289838 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:11.290413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:11.290916 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:11.291904 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:11.292426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:11.293075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:11.312209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:06:11.317049 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:06:11.328260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:06:11.331390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:06:11.382616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8b27aae-9098-426d-a5de-de2de2e54891 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716040 Oct 03 16:06:11.383560 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 413/849] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:06:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:06:11.395988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4c5249d-49c2-4b80-b004-62e6e4d61662 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:11.396585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4c5249d-49c2-4b80-b004-62e6e4d61662 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:11.461959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4c5249d-49c2-4b80-b004-62e6e4d61662 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:11.469891 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4c5249d-49c2-4b80-b004-62e6e4d61662 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1240 microversion: 2.1 time: 0.079423 Oct 03 16:06:11.470821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 437/850] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:11 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:12.493376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:12.493997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:12.502987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:12.503481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:12.503917 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:12.504622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:12.505108 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:12.505534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:12.626918 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:12.635036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-786af2e6-ff78-408e-b8cc-799a81d777d7 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1292 microversion: 2.1 time: 0.146152 Oct 03 16:06:12.635937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 414/851] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:12 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:13.659557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:13.660168 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:13.667838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:13.668320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:13.668770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:13.671501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:13.673343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:13.674102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:13.904114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:13.913634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ddf6701-85c0-4b24-b467-612647932c51 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.257704 Oct 03 16:06:13.914444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 438/852] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:13 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:14.214518 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3245cd-404a-4f9a-aa0f-53ea7d62f307", "tag": "892ca207-a78f-4eba-9597-1f7f9ffee804"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:14.233559 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:14.234047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:14.234675 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:14.247549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] Creating event network-changed:892ca207-a78f-4eba-9597-1f7f9ffee804 for instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 on hv-cinder-84456 Oct 03 16:06:14.253723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8d8dd773-6911-4458-8716-55dfd463e867 req-ccf998aa-ebe4-4fa0-a3bf-fead6fc89814 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043010 Oct 03 16:06:14.254975 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 415/853] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:14.936417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:14.937065 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:14.944058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:14.944544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:14.945002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:14.945702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:14.946153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:14.946573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:15.087901 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:15.095677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa64ffec-904e-4176-8ab6-fdcab5ca0178 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.163053 Oct 03 16:06:15.096228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 439/854] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:14 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:16.119307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:16.119996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:16.126397 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:16.126792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:16.127220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:16.127897 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:16.128343 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:16.128783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:16.256836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:16.264621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cebcd6d6-f591-4903-b3d4-f969ae2faa15 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.150050 Oct 03 16:06:16.265206 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 416/855] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:16 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:17.288241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:17.288868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:17.295246 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:17.295714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:17.296140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:17.296920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:17.298023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:17.298643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:17.435163 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:17.443103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-983728ce-bbc4-4387-9719-93264c551985 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.158685 Oct 03 16:06:17.443673 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 440/856] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:17 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:18.466173 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:18.466788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:18.473564 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:18.474048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:18.474485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:18.475175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:18.475626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:18.476049 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:18.604110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:18.612796 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-703b20cc-6778-4b86-b804-fcf4f8e4b22d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.150435 Oct 03 16:06:18.613534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 417/857] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:18 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:19.636250 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:19.636892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:19.648937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:19.649428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:19.649865 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:19.650560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:19.651013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:19.651435 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:19.778773 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:19.787146 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58de21a0-02f0-4059-afde-b5ef75aa9d33 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.154775 Oct 03 16:06:19.787712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 441/858] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:19 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:20.277924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3245cd-404a-4f9a-aa0f-53ea7d62f307", "name": "network-vif-plugged", "status": "completed", "tag": "892ca207-a78f-4eba-9597-1f7f9ffee804"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:20.289750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:20.290320 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:20.291040 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:20.304813 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] Creating event network-vif-plugged:892ca207-a78f-4eba-9597-1f7f9ffee804 for instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 on hv-cinder-84456 Oct 03 16:06:20.311251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2682ff74-602a-4c08-8c8a-04b35cd69dea req-bef9521e-59ea-4759-9cc5-13f28dad3721 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037447 Oct 03 16:06:20.311842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 418/859] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:06:20.810040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:20.810644 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:20.817343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:20.817827 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:20.818284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:20.818969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:20.819419 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:20.819840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:20.948705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:20.956842 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bd0ad25-9c6d-4687-8ff1-1dc046395e14 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.150661 Oct 03 16:06:20.957400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 442/860] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:20 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:21.978506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:21.979368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:21.983465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:21.984164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:21.991846 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:21.992322 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:21.992777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:21.993470 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:21.993920 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:21.994340 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:22.130948 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:22.138718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77169afc-f8c6-4fe2-b075-88ae23395182 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1366 microversion: 2.1 time: 0.161655 Oct 03 16:06:22.139284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 419/861] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:21 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:06:23.161537 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:23.162138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:23.166450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:06:23.170910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:23.171557 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:23.172181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:23.172910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:23.173515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:23.174226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:23.307956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:23.315882 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8ae4908-de74-4fb9-9315-dd83c6c76eb1 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1555 microversion: 2.1 time: 0.158112 Oct 03 16:06:23.316436 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 443/862] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:06:23 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:06:23.338152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:23.338639 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:23.345875 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:23.346348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:23.346783 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:23.347471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:23.347925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:23.348344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:23.429614 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-add2f82b-2933-4796-8043-afe7a2df0677 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095513 Oct 03 16:06:23.430208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 420/863] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:06:23 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:24.380093 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3245cd-404a-4f9a-aa0f-53ea7d62f307", "tag": "892ca207-a78f-4eba-9597-1f7f9ffee804"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:24.398670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:24.399312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:24.399809 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:24.411812 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] Creating event network-changed:892ca207-a78f-4eba-9597-1f7f9ffee804 for instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 on hv-cinder-84456 Oct 03 16:06:24.417160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f50147eb-557f-419e-a421-bedc69bfef5e req-77172674-bc10-4ace-991c-ee65a089daf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040498 Oct 03 16:06:24.417928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 444/864] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:28.864215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:28.866621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:28.873106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:28.873685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:28.874191 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:28.875538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:28.876656 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:28.877110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:28.911055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49f80dbc-23ab-427c-8604-dfe34bc0d8ab tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052048 Oct 03 16:06:28.911706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 421/865] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Oct 3 16:06:28 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:28.982464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:28.983112 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:28.989721 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:28.990206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:28.990640 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:28.991337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:28.991789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:28.992212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:29.020153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:06:29.103584 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-64138a67-5be5-4e19-8fa8-75526ecc5f36 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 204 len: 0 microversion: 2.20 time: 0.125577 Oct 03 16:06:29.104564 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 445/866] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 16:06:28 2022] DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 16:06:29.114842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:29.115456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:29.121383 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:29.121866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:29.122298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:29.122996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:29.123448 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:29.123937 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:29.251684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:29.259889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:29.261374 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:29.262546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5efd956d-1ea3-4c17-b53e-83174b87afea tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.152754 Oct 03 16:06:29.263093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 422/867] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:29 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:06:30.288950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:30.289641 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:30.296038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:30.296508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:30.297944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:30.298833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:30.299309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:30.299700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:30.446451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:30.456620 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:30.458149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:30.459366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22a57508-7e32-4315-a0ff-3300f1add48a tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1719 microversion: 2.20 time: 0.174798 Oct 03 16:06:30.459986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 446/868] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:30 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:06:31.486325 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:31.487684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:31.496664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:31.498299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:31.499022 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:31.500310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:31.501442 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:31.502113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:31.591806 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489060aa-1904-4f0e-aed7-9ac1d9806dc7", "name": "network-vif-deleted", "tag": "2ef89318-7121-40f5-84c6-aa3a58207f20"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:31.601812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:31.611243 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:31.612835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:31.613544 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:31.620205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:31.622028 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e113c9ec968460ba070cfc1a69a25a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee0d51f58e4abd8867c54458f504fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:31.623372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b81cb161-cd2c-4e44-999f-e375b9b786d4 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 200 len: 1654 microversion: 2.20 time: 0.142570 Oct 03 16:06:31.636794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 423/869] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:31 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 16:06:31.639188 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] Creating event network-vif-deleted:2ef89318-7121-40f5-84c6-aa3a58207f20 for instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 on hv-cinder-84456 Oct 03 16:06:31.648465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-572f78f2-45d0-484e-9772-e59514ff27d0 req-a4240f1e-5b30-4a1a-a184-808c56da8515 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072122 Oct 03 16:06:31.649415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 447/870] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:06:32.654308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:32.654903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:32.662467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:32.662971 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:32.663411 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:32.664115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:32.664565 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:32.665011 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:32.680405 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 HTTP/1.1 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:06:32.682129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:32.683623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '489060aa-1904-4f0e-aed7-9ac1d9806dc7'} Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:06:32.684412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:32.685903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:32.687101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:06:32.687101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-480ab826-822d-4ede-91e3-03ac7f0be019 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 404 len: 111 microversion: 2.20 time: 0.034461 Oct 03 16:06:32.687101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 424/871] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:32 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:06:32.693824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eef7ddda-c490-45b9-95cd-464b661afb31 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '.version_select at 0x7f817852e160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:32.715505 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eef7ddda-c490-45b9-95cd-464b661afb31 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51833190" status: 204 len: 0 microversion: 2.20 time: 0.026247 Oct 03 16:06:32.716087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 448/872] 10.222.0.33 () {60 vars in 1256 bytes} [Mon Oct 3 16:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51833190 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 16:06:34.499111 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:34.499712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:34.506841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:34.507288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:34.507715 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:34.508393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:34.508865 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:34.509283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:34.523024 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 HTTP/1.1 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:06:34.524543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.526171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '489060aa-1904-4f0e-aed7-9ac1d9806dc7'} Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:06:34.527074 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.528534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.530012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:06:34.530012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a7bbefd-aba1-492b-917b-36eb58b66fec tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 404 len: 111 microversion: 2.20 time: 0.030738 Oct 03 16:06:34.530012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 425/873] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 16:06:34 2022] DELETE /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:06:34.535160 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:34.535885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: 489060aa-1904-4f0e-aed7-9ac1d9806dc7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:34.543384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:34.543877 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:34.544289 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:34.544995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:34.545453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:34.545875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:34.560089 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 HTTP/1.1 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:06:34.561730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.563593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '489060aa-1904-4f0e-aed7-9ac1d9806dc7'} Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:06:34.564354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. Oct 03 16:06:34.565595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:34.566714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance 489060aa-1904-4f0e-aed7-9ac1d9806dc7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:06:34.566714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93018a49-2195-49e0-a284-53352e47c736 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7" status: 404 len: 111 microversion: 2.20 time: 0.032577 Oct 03 16:06:34.566714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 449/874] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:34 2022] GET /compute/v2.1/servers/489060aa-1904-4f0e-aed7-9ac1d9806dc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:06:35.709849 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:35.710351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:35.716997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:35.717471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:35.717900 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:35.719362 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:35.719869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:35.720290 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:35.742678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 HTTP/1.1 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:06:35.744766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.746601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'c36b3edc-789f-4598-973a-889f9678a395'} Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:06:35.747524 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.749205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.751268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:06:35.751268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7e9e00f-a894-4e0d-878c-5c9d5a659f73 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 404 len: 111 microversion: 2.20 time: 0.041305 Oct 03 16:06:35.751268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 426/875] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Oct 3 16:06:35 2022] DELETE /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:06:35.756473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:06:35.757106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] [instance: c36b3edc-789f-4598-973a-889f9678a395] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:06:35.763545 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:35.764043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:35.764473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:35.765354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:35.765865 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:35.766180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:35.779588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] HTTP exception thrown: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Request method failure captured: Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 HTTP/1.1 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwbWSjMxo0wF6bW-0YbSURXjp_CZxB5HgdHX-VBLG7hlt9jYBqNIysha8yOEcJ9PY-5ZI7y_if4qDjTfh_q8UsP0ZJPMFfDByCB72Jm2PwlBTFIscMuTbqSSpG33PLts56GOA3tT9G6priiufNPxITjMoq1Jd6vLCQPhj5KzMyYh9vw Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:06:35.781324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ee0d51f58e4abd8867c54458f504fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ee0d51f58e4abd8867c54458f504fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d7ee0d51f58e4abd8867c54458f504fc Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1695482785 Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 5e113c9ec968460ba070cfc1a69a25a1 Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1695482785-project Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.782986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'c36b3edc-789f-4598-973a-889f9678a395'} Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:06:35.783869 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. Oct 03 16:06:35.785418 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:06:35.786704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] Returning 404 to user: Instance c36b3edc-789f-4598-973a-889f9678a395 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:06:35.786704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62cc9ac3-5335-4f1a-851a-96cf038320f5 tempest-AttachVolumeShelveTestJSON-1695482785 tempest-AttachVolumeShelveTestJSON-1695482785-project] 10.222.0.33 "GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395" status: 404 len: 111 microversion: 2.20 time: 0.029870 Oct 03 16:06:35.786704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 450/876] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Oct 3 16:06:35 2022] GET /compute/v2.1/servers/c36b3edc-789f-4598-973a-889f9678a395 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:07:00.587499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:00.588021 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:00.590070 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:00.590704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=58 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:00.597198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.597876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.598314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.599008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.599460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.599884 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.627982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a06fd85b-5874-4ee4-b594-50c203133646 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/ips" status: 200 len: 149 microversion: 2.1 time: 0.045647 Oct 03 16:07:00.628552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 427/877] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:07:00 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:00.640891 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aee80fa0-553c-45ba-b1b1-789f617f7aca"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:00.643479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:00.645840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:00.646550 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:00.652119 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.652607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.653072 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.653771 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.654229 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.654657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.743431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/os-volume_attachments HTTP/1.1 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 74 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:07:00.745138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "aee80fa0-553c-45ba-b1b1-789f617f7aca"}} Oct 03 16:07:00.746830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'server_id': 'ae3245cd-404a-4f9a-aa0f-53ea7d62f307', 'body': {'volumeAttachment': {'volumeId': 'aee80fa0-553c-45ba-b1b1-789f617f7aca'}}} Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:00.747689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:00.748995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 400 to user: Invalid volume: volume aee80fa0-553c-45ba-b1b1-789f617f7aca is already attached to instances: 8c3d4b57-0c64-40bb-8710-b8e721815147 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b5427a3-0631-4fc3-b99b-560d4273b382 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110434 Oct 03 16:07:00.751573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 451/878] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:07:00 2022] POST /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:07:00.756358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:00.756922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:00.763012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.763496 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.763934 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.764629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.765199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.765627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.793995 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:07:00.876499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f64d2e2-3528-4aaf-b317-037af61353ed tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 204 len: 0 microversion: 2.1 time: 0.123484 Oct 03 16:07:00.877122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 428/879] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:07:00 2022] DELETE /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:07:00.885508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:00.886114 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:00.893018 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.893500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.893926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:00.894795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:00.895257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:00.895672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:01.065060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:01.072749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19baab2d-0e41-4584-a4ce-286253d56d5e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1680 microversion: 2.1 time: 0.191123 Oct 03 16:07:01.073310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 452/880] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:00 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:02.098733 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:02.099417 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:02.106150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:02.106638 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:02.107077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:02.107816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:02.108276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:02.109341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:02.342571 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:02.350485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92737e19-7d6e-47b0-8973-609b20e84dea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1680 microversion: 2.1 time: 0.256117 Oct 03 16:07:02.350982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 429/881] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:02 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:03.362966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3245cd-404a-4f9a-aa0f-53ea7d62f307", "name": "network-vif-deleted", "tag": "892ca207-a78f-4eba-9597-1f7f9ffee804"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:03.373812 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:03.375188 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:03.382068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:03.382580 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:03.382885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:03.383001 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:03.383366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:03.383705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:03.383855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:03.384471 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:03.385143 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:03.399574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] Creating event network-vif-deleted:892ca207-a78f-4eba-9597-1f7f9ffee804 for instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 on hv-cinder-84456 Oct 03 16:07:03.415019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ad16dce2-b772-46d8-ba54-7bf7bd992d75 req-b32be3ed-2343-40a7-b658-bb9c4ba1f73d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056198 Oct 03 16:07:03.416482 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 453/882] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:03.461836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:03.470404 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0d61ccc-7698-4a24-82aa-4f2e3f6c7bd0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1612 microversion: 2.1 time: 0.100455 Oct 03 16:07:03.471077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 430/883] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:03 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:04.494339 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:04.495661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:04.503748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:04.504334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:04.504884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:04.505681 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:04.506139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:04.506616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:04.582999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:04.593611 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa036199-7dd9-412c-93dc-a7c428b6839e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1325 microversion: 2.1 time: 0.103470 Oct 03 16:07:04.594573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 454/884] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:04 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:05.615851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:05.616467 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:05.633771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:05.634460 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:05.635276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:05.636162 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:05.636798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:05.637380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:05.752676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:05.762658 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a023b246-b6e9-4c41-b6cf-b7a83f72f4a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1325 microversion: 2.1 time: 0.150609 Oct 03 16:07:05.764050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 431/885] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:05 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:06.787636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:06.788245 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:06.795198 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:06.796596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:06.797278 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:06.798316 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:06.799015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:06.799719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:06.848040 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:06.848536 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:06.848998 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:06.849639 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid ae3245cd-404a-4f9a-aa0f-53ea7d62f307 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:06.900143 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:06.909386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44e31d06-9a91-4fb5-a583-63d0008c855b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1330 microversion: 2.1 time: 0.125580 Oct 03 16:07:06.910137 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 455/886] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:06 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:07.933584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:07.934201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:07.941423 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:07.942125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:07.942569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:07.943329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:07.943793 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:07.944222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:07.981381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:07.981857 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:07.982291 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:07.982740 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid ae3245cd-404a-4f9a-aa0f-53ea7d62f307 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:08.035488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:08.046622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4dd1e30f-3171-4faf-b044-2635e1a76ad9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1330 microversion: 2.1 time: 0.116295 Oct 03 16:07:08.047341 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 432/887] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:07 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:09.070733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:09.071349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:09.080302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:09.081064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:09.081665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:09.082719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:09.083942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:09.089405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:09.151748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:09.153574 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:09.154200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:09.154664 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid ae3245cd-404a-4f9a-aa0f-53ea7d62f307 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:09.199318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:09.208338 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50d728d2-d274-4d2b-81f7-9186efd0701c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1330 microversion: 2.1 time: 0.141583 Oct 03 16:07:09.221944 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 456/888] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:09 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1330 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:10.239317 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:10.240675 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:10.252372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:10.253398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:10.254257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:10.255430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:10.256529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:10.257210 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:10.340115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:10.345841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:10.346463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:10.347000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid ae3245cd-404a-4f9a-aa0f-53ea7d62f307 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:10.413249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:10.423866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b5f642a-5bd7-4e89-9f0a-62586ceddcb0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1330 microversion: 2.1 time: 0.193220 Oct 03 16:07:10.425174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 433/889] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:10 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1330 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:11.451462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:11.452380 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:11.462108 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:11.462600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:11.463770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:11.464969 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:11.465431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:11.465851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:11.509777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:11.510265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:11.510699 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:11.511152 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid ae3245cd-404a-4f9a-aa0f-53ea7d62f307 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:11.594859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:11.620362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82a510fb-8bdf-4f71-b572-d6998c022b78 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 200 len: 1330 microversion: 2.1 time: 0.175792 Oct 03 16:07:11.620973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 457/890] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:11 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 1330 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:12.648297 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:12.649003 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:12.656098 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:12.656587 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:12.657050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:12.657752 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:12.658482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:12.658990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:12.673777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 HTTP/1.1 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:07:12.675468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:07:12.677207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'ae3245cd-404a-4f9a-aa0f-53ea7d62f307'} Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:07:12.678093 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:07:12.679650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:07:12.681067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:07:12.681067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e461452-dd3c-4ee9-a2b6-892e512aed79 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 404 len: 111 microversion: 2.1 time: 0.032474 Oct 03 16:07:12.681067 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 434/891] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:12 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:07:12.687415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-052869b0-16fd-4e03-99de-c4d735c7ca4e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '.version_select at 0x7f8178532280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:12.708917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-052869b0-16fd-4e03-99de-c4d735c7ca4e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166469587" status: 202 len: 0 microversion: 2.1 time: 0.026287 Oct 03 16:07:12.709505 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 458/892] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166469587 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:07:13.604964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:13.605472 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:13.617682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:13.618458 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:13.619066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:13.619961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:13.620943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:13.621544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:13.740196 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'services' on Instance uuid 8c3d4b57-0c64-40bb-8710-b8e721815147 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:13.847798 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28020979-3e71-4074-96ce-c77ffc4c9422 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments/aee80fa0-553c-45ba-b1b1-789f617f7aca" status: 202 len: 0 microversion: 2.1 time: 0.246291 Oct 03 16:07:13.852649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 435/893] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:07:13 2022] DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments/aee80fa0-553c-45ba-b1b1-789f617f7aca => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:07:13.861597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:13.867336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:13.894530 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:13.895026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:13.900597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:13.901720 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:13.902362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:13.902976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:13.973429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0c00fc4-58fd-472e-905c-84554cdae283 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117799 Oct 03 16:07:13.978821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 459/894] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:07:13 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:14.755743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1077333022", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215967939", "security_groups": [{"name": "tempest-secgroup-smoke-1333872185"}], "block_device_mapping_v2": [{"uuid": "e8c83a68-a1b2-4a6d-aeb7-9f53e62b6bde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "13403649-4ce4-4f7b-972e-1b4b67982742"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:14.987396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:14.990309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:15.004063 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] validate_networks() for [('13403649-4ce4-4f7b-972e-1b4b67982742', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:07:15.011910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.012824 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.013492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.014503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.018083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.018798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.079320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4550ed9f-db4f-465f-8d73-0e5d31774272 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097373 Oct 03 16:07:15.082197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 460/895] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:07:14 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:07:15.216287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:15.216287 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:15.233908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.234412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.234850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.235566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.236023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.236453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.291825 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:07:15.417569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ecc7a27-4a34-4411-9832-cfd359e0cd9e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 204 len: 0 microversion: 2.1 time: 0.210626 Oct 03 16:07:15.422161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 461/896] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:07:15 2022] DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:07:15.435890 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:15.439222 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:15.446990 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.447833 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.449280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.450333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.451011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.452601 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.745451 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:15.758004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-554865c3-774b-4965-870a-cd989d027080 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1680 microversion: 2.1 time: 0.329668 Oct 03 16:07:15.765156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 462/897] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:15 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1680 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:15.809166 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:07:15.810198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:07:15.811066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:07:15.812201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:07:15.812896 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:07:15.824321 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.825804 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.826468 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.828205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:15.828959 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:15.829625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:15.852544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:07:15.857140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Getting quotas for user 7377a1bca391446eb36b2a3233a7d471 and project 40732e98240b4797b941e57f6606e6c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:07:15.938207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:07:15.940755 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8c83a68-a1b2-4a6d-aeb7-9f53e62b6bde',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:07:16.137263 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30f338da-d69f-4842-af12-60d48da4e7dd tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.385713 Oct 03 16:07:16.138482 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 436/898] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:07:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:07:16.153855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df61d651-fbda-4698-9df1-99bdfef7877c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:16.156259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df61d651-fbda-4698-9df1-99bdfef7877c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:16.257369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-df61d651-fbda-4698-9df1-99bdfef7877c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:16.267042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df61d651-fbda-4698-9df1-99bdfef7877c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1094 microversion: 2.1 time: 0.120559 Oct 03 16:07:16.268977 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 463/899] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:16 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:16.789363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:16.790000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:16.815296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:16.815791 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:16.816191 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:16.824251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:16.825121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:16.825567 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:17.087088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:17.097632 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e31ef2f0-10fa-4046-9c8a-b4bb61fd01d2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1680 microversion: 2.1 time: 0.316273 Oct 03 16:07:17.126131 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 437/900] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:16 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1680 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:17.293950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:17.295253 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:17.330953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:17.331820 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:17.332508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:17.333533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:17.334205 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:17.334840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:17.461804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:17.474060 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66fdaa50-608b-4163-95ad-48b43bc5cb7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1192 microversion: 2.1 time: 0.184629 Oct 03 16:07:17.474684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 464/901] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:17 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1192 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:18.132664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:18.133345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:18.141655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:18.142157 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:18.142602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:18.143316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:18.143771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:18.144198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:18.414727 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:18.429128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bdce797-861e-489f-9dd3-d26e4688e509 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1680 microversion: 2.1 time: 0.300789 Oct 03 16:07:18.430129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 438/902] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:18 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1680 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:18.502587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:18.503368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:18.513417 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:18.519474 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:18.522217 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:18.523121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:18.530302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:18.532329 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:18.699858 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:18.710953 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d828d7a3-ab29-4902-a401-04de3228dab4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1210 microversion: 2.1 time: 0.212957 Oct 03 16:07:18.712981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 465/903] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:18 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:19.455342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:19.456036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:19.474508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:19.475280 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:19.476189 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:19.479379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:19.480036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:19.482376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:19.608891 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:19.627596 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1f1a1a7-95c7-4738-b3c0-ee4944ed9090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1612 microversion: 2.1 time: 0.176872 Oct 03 16:07:19.657204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 439/904] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:19 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1612 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:19.738423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:19.739735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:19.750492 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:19.752164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:19.756919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:19.757915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:19.760677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:19.761384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:19.838394 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d4b57-0c64-40bb-8710-b8e721815147", "name": "network-vif-deleted", "tag": "406bfa19-5892-4c1a-b4c3-d8446200dae5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:19.872701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:19.878723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:19.880653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:19.914006 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] Creating event network-vif-deleted:406bfa19-5892-4c1a-b4c3-d8446200dae5 for instance 8c3d4b57-0c64-40bb-8710-b8e721815147 on hv-cinder-84456 Oct 03 16:07:19.919542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8143a2f0-2490-4c7f-adda-0495c4b6baf2 req-09b5bef6-5f43-4045-84e7-4bab55082a10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085289 Oct 03 16:07:19.924252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 440/905] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:20.174743 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:20.198581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a3b6016-634f-42c6-aef1-a7c434e3455a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.464986 Oct 03 16:07:20.198840 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 466/906] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:19 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:20.658109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:20.658818 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:20.668153 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:20.668910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:20.669532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:20.671215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:20.671842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:20.672538 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:20.715225 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:20.715979 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:20.716581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:20.717351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid 8c3d4b57-0c64-40bb-8710-b8e721815147 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:20.778144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:20.790840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03f7e403-c6ad-43de-8828-1a895a5a0f0e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1331 microversion: 2.1 time: 0.134731 Oct 03 16:07:20.791439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 441/907] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:20 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:21.065984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e780e0-bcef-4ffd-acd9-5b2e2149670b", "tag": "b2a35698-8aad-47ff-b894-6f9f24d5bfad"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:21.087599 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.088252 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.091599 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.119167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] Creating event network-changed:b2a35698-8aad-47ff-b894-6f9f24d5bfad for instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b on hv-cinder-84456 Oct 03 16:07:21.125657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5ff5f33e-4279-430d-9e63-093d10b4130f req-810b8728-418f-4366-8749-2a3a20621227 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064629 Oct 03 16:07:21.126946 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 467/908] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:21.235742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:21.236899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:21.253771 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.254528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.255192 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.256102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.259780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.260620 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.295792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:21.452105 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:21.460102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b28a7061-a066-48f8-b28d-6c1495ae2c7a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.235761 Oct 03 16:07:21.469445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 442/909] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:21 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:21.814822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:21.815531 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:21.822231 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.822753 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.823200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.823897 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.824348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.824792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.829573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:21.861760 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:21.862257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:21.862686 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:21.863137 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid 8c3d4b57-0c64-40bb-8710-b8e721815147 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:21.911623 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:21.919857 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a762d38d-d42e-4677-a9b4-91410bec507f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1331 microversion: 2.1 time: 0.109400 Oct 03 16:07:21.933088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 468/910] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:21 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:22.487139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:22.487808 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:22.494702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:22.495255 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:22.495772 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:22.496528 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:22.497072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:22.497567 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:22.641629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:22.649921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4377ec52-b989-44cf-810f-1e6718da324b tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.169069 Oct 03 16:07:22.650480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 443/911] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:22 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:22.946020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:22.948508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:22.955257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:22.955834 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:22.958490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:22.959263 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:22.959884 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:22.960737 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:23.000792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:23.001437 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:23.002083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:23.002690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'fault' on Instance uuid 8c3d4b57-0c64-40bb-8710-b8e721815147 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:07:23.047569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:23.056154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-154a4ed3-3087-46be-97f8-1ed453f9935c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 200 len: 1331 microversion: 2.1 time: 0.116550 Oct 03 16:07:23.056979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 469/912] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:22 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:23.672513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:23.673414 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:23.684409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:23.687667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:23.688582 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:23.689612 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:23.691661 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:23.692348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:23.875968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:23.884055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91891a81-d0d8-4525-826e-0842df6d8b78 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.216485 Oct 03 16:07:23.885262 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 444/913] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:23 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:24.082154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:24.083462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:24.090903 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:24.091679 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:24.092428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:24.093416 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:24.094202 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:24.094750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:24.111878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 HTTP/1.1 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:07:24.113947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:07:24.115547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '8c3d4b57-0c64-40bb-8710-b8e721815147'} Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:07:24.116476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:07:24.117978 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:07:24.120396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:07:24.120396 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-810d69e4-e178-4ede-9631-c06957e6241f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 404 len: 111 microversion: 2.1 time: 0.042117 Oct 03 16:07:24.122429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 470/914] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:24 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:07:24.129215 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92b7b071-5562-4150-ac4d-08fe9ef34705 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '.version_select at 0x7f8174d99b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:24.155739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92b7b071-5562-4150-ac4d-08fe9ef34705 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934826114" status: 202 len: 0 microversion: 2.1 time: 0.030960 Oct 03 16:07:24.159655 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 445/915] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934826114 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:07:24.908786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:24.909622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:24.917262 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:24.917981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:24.918596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:24.919604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:24.921373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:24.921373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:25.043881 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-880cd612-71e1-44a4-87da-38536948006e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: .version_select at 0x7f8174d4eca0>, body: {"keypair": {"name": "tempest-keypair-359432975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIFboDqRtSyQn7T+YGY2ptqCAZiign6M7zgouvkkIUkVluUJldQpfmy8SISNowQPhQ5qotWLAzFPIacJ+dpNMxyH97r4Kpl6ePpQrf/Mea7WCPOlzbUM9jcJFve2LG9BA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:25.074453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-880cd612-71e1-44a4-87da-38536948006e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:07:25.081883 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-880cd612-71e1-44a4-87da-38536948006e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:07:25.110372 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-880cd612-71e1-44a4-87da-38536948006e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070919 Oct 03 16:07:25.110966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 446/916] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:07:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:25.112546 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:25.126679 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5b82641-ca28-4cd5-ac3d-52c00b2cdc8a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.222969 Oct 03 16:07:25.127256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 471/917] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:24 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:25.413712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f46db57-3fc5-4415-80ac-c63e23996012 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'create', calling method: .version_select at 0x7f8174b71670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1261642195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPV9gGyX3mkkQmGdsWKPzh4tOTRrcPGtJ+EbUcQ6E+0hb+e8ssrGflsgtzXWwjYwVEphF8zJZvM0VwVEpWM70IkdioubgVaJYCWFTihtj8pq+D7yV7jmSOK/eqySeUWDw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:25.431705 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f46db57-3fc5-4415-80ac-c63e23996012 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Getting quotas for project a7ffe330a5d2482e961c93077d13cc5b. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:07:25.435695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f46db57-3fc5-4415-80ac-c63e23996012 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Getting quotas for user 7fe42f8d88c540418580fb8c668bf2de and project a7ffe330a5d2482e961c93077d13cc5b. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:07:25.458194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f46db57-3fc5-4415-80ac-c63e23996012 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048342 Oct 03 16:07:25.458789 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 447/918] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:07:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:25.512665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1392555209", "imageRef": "58dd4b6e-8ff6-4bfc-8276-837640942a52", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1261642195", "networks": [{"uuid": "9b506095-b239-4c3c-b1a3-9e4b5609e07c"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:25.573302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] validate_networks() for [('9b506095-b239-4c3c-b1a3-9e4b5609e07c', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:07:25.972191 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:07:25.972607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:07:25.973101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:07:25.973505 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:07:25.973909 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:07:25.983365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:25.984098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:25.984742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:25.985479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:25.985947 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:25.986354 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:26.004421 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Getting quotas for project a7ffe330a5d2482e961c93077d13cc5b. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:07:26.009212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Getting quotas for user 7fe42f8d88c540418580fb8c668bf2de and project a7ffe330a5d2482e961c93077d13cc5b. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:07:26.022118 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:07:26.024576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58dd4b6e-8ff6-4bfc-8276-837640942a52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:07:26.079764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8280c971-c6ef-45ec-8a8e-07fd48772bc2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570953 Oct 03 16:07:26.080415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 472/919] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 16:07:26.088389 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:26.093071 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c17e03e-3050-497b-ad46-66d80684b35b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:26.093694 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c17e03e-3050-497b-ad46-66d80684b35b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:26.151801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:26.152401 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:26.162524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:26.163334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:26.163995 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:26.164907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:26.168962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c17e03e-3050-497b-ad46-66d80684b35b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:26.178575 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c17e03e-3050-497b-ad46-66d80684b35b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1259 microversion: 2.1 time: 0.090678 Oct 03 16:07:26.179086 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 448/920] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:26 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1259 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:26.189494 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:26.199872 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:26.366413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:26.378830 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bb2c06d-e76f-4700-8bfb-0717dc42986f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.231382 Oct 03 16:07:26.394303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 473/921] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:26 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:26.544424 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-328123974", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b5f831-720b-4bbf-8b1b-0fa2209326c5"}], "security_groups": [{"name": "tempest-securitygroup--1465721908"}], "key_name": "tempest-keypair-359432975", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:26.652704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] validate_networks() for [('87b5f831-720b-4bbf-8b1b-0fa2209326c5', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:07:26.845976 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:27.050055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:07:27.050604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:07:27.051101 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:07:27.051506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:07:27.051910 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:07:27.061464 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.061464 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.061873 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.062595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.063042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.063457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.080127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:07:27.084036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:07:27.096217 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:07:27.098695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:07:27.145566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d40ecb1-3c76-48a2-b855-c0213d3bb584 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605721 Oct 03 16:07:27.146219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 449/922] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:07:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:07:27.157986 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2225b71-ce70-4988-8533-80ee3ab6f6b8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:27.158689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2225b71-ce70-4988-8533-80ee3ab6f6b8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:27.203489 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:27.204213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:27.211144 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.211711 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.212245 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.213226 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.213753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.217416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.217851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2225b71-ce70-4988-8533-80ee3ab6f6b8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:27.225045 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2225b71-ce70-4988-8533-80ee3ab6f6b8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1240 microversion: 2.1 time: 0.071570 Oct 03 16:07:27.225613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 474/923] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:27 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:27.291760 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:27.303052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e44c8ce-f7cb-49d2-a152-b7c84ccec70b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1311 microversion: 2.1 time: 0.103952 Oct 03 16:07:27.303907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 450/924] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:27 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:27.408133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:27.408831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:27.416471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.417325 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.418121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.419226 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:27.419367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:27.419796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:27.591028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:27.602285 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e374e2f-1432-40c4-a707-49f22ac83158 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.200433 Oct 03 16:07:27.603368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 475/925] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:27 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:28.252618 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:28.253453 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:28.267078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.267659 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.268758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.271517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.271996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.273203 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.332398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:28.333036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:28.352837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.358448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.358983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.359795 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.361317 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.361783 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.469455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:28.490529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e2b14e5-a7ba-42c8-a7b5-d052dd7ae090 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.243036 Oct 03 16:07:28.491194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 451/926] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:28 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:28.632010 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:28.632781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:28.643634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.645083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.646158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.647184 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:28.647858 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:28.652034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:28.662199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:28.668083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32076bae-4ffe-4b7b-acda-4fafbfdd49d7 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.340016 Oct 03 16:07:28.671902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 476/927] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:28 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:28.932704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:28.942519 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3af21d75-1047-48d9-b76f-a96504583e10 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.315207 Oct 03 16:07:28.945390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 452/928] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:28 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:29.519467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:29.520938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:29.547997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.549412 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.549984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.550801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.551521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.552077 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.642095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:29.652313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9a3503a-2c8d-462a-b072-bf4e06766b7c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.141881 Oct 03 16:07:29.653610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 477/929] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:29 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:29.698743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:29.699358 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:29.723599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.728257 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.728768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.729840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.730316 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.732857 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.956650 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:29.970533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:29.971268 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:29.973603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4166f06e-ff80-4b26-a396-1ac20cba862b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.279698 Oct 03 16:07:29.979183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.980349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.981997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.983687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:29.984332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:29.985028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:29.998746 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 453/930] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:29 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:30.156302 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:30.167566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19b4ab99-43bf-4c43-85a9-9482b830b1e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.205693 Oct 03 16:07:30.168154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 478/931] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:29 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:30.677014 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:30.677723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:30.684310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:30.685060 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:30.686232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:30.687152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:30.687617 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:30.688045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:30.775110 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:30.785706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee7c4e36-bbed-485e-a66c-89ba7a8f20fe tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.113318 Oct 03 16:07:30.786307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 454/932] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:30 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:31.004925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:31.005685 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:31.008320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:31.014258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.015485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.016136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.017123 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.017831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.018422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.191222 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:31.192195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:31.200534 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:31.202949 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.203715 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.205128 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.206567 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.207941 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.210581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5125f245-2b42-4c7b-b2dd-7b3d66fa03e4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.209372 Oct 03 16:07:31.211227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.212151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 479/933] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:30 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:31.385130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:31.394379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4902e2e-44bd-4616-be66-c8e1372c89e5 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.207142 Oct 03 16:07:31.405462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 455/934] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:31 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:31.810761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:31.813617 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:31.839103 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.840147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.840776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.841815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:31.843677 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:31.845925 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:31.934851 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:31.944711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7451232-9c16-4b2a-a5a0-faef2012a91f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.139579 Oct 03 16:07:31.945668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 480/935] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:31 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:32.238952 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:32.240477 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:32.247227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.248385 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.249254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:32.250329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.250994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.251647 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:32.418777 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:32.419390 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:32.427345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.428671 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.434873 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:32.437144 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.437791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.438385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:32.517045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:32.527665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bab8f9bb-7863-4ccd-a8b9-7a25c46b9810 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.294535 Oct 03 16:07:32.528500 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 456/936] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:32 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:32.656021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:32.674928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85709e87-9734-467f-a1b8-b37be2306cd8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.260216 Oct 03 16:07:32.686025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 481/937] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:32 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:32.968743 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:32.969758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:32.976236 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.977021 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.977621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:32.978499 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:32.979113 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:32.979853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:33.071435 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:33.079659 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57c23cce-0b3a-4d7d-9739-a16e46df4729 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.116004 Oct 03 16:07:33.082441 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 457/938] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:32 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:33.556400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:33.556400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:33.565733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:33.566398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:33.567129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:33.567955 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:33.568616 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:33.569127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:33.701050 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:33.701950 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:33.712096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:33.713690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:33.714332 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:33.715276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:33.722227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:33.726534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:33.745526 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:33.754965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f10ab820-9dd3-4cf0-b8a8-8bfbeec7c522 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.207100 Oct 03 16:07:33.756125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 482/939] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:33 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:33.931294 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:33.941345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60858a1b-0ffd-4f74-9f2a-171e3741a3a0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.244427 Oct 03 16:07:33.943102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 458/940] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:33 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:34.111730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:34.112358 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:34.118603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.119612 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.120020 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.120736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.121203 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.122006 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.199567 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:34.207998 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a031349b-bad6-4e7d-ba13-17015a8f26d9 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.103854 Oct 03 16:07:34.209784 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 483/941] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:34 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:34.782445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:34.783058 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:34.789831 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.790498 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.791201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.792633 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.793700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.794346 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.968098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:34.968700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:34.978892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.979649 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.980249 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.982753 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:34.986694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:34.987398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:34.993307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:35.007840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-732146ca-0111-47a8-b94e-8c1e9f8a769f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.224579 Oct 03 16:07:35.010447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 459/942] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:34 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:35.188227 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:35.197244 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efc1ee69-e167-4e9d-b99f-f81d30052dbf tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.233582 Oct 03 16:07:35.199261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 484/943] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:34 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:35.233741 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:35.235323 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:35.254045 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:35.288324 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:35.288324 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:35.288324 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:35.288324 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:35.288777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:35.374403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:35.382781 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae116cc4-54f9-4ce4-af1f-6288e74e1dc0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.152771 Oct 03 16:07:35.383657 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 460/944] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:35 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:36.027017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:36.027621 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:36.030294 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:36.035729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.036207 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.036634 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.037355 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.037828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.038265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.171606 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:36.181524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8645230-24b2-4959-9971-002234736be3 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.158595 Oct 03 16:07:36.182238 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 485/945] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:36 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:36.225841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:36.226544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:36.233619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.234108 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.234753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.235457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.236083 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.236516 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.409122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:36.410345 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:36.419156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.421443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.422259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.423307 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:36.424079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:36.425101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:36.453555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:36.604343 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:36.614846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad8b756d-4789-4749-a989-5a0734535409 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1292 microversion: 2.1 time: 0.211021 Oct 03 16:07:36.625379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 486/946] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:36 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:36.687018 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:36.694758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96ec0134-6bcd-4fdc-8a83-3c33940ec4e4 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.472887 Oct 03 16:07:36.695418 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 461/947] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:36 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:37.129169 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:37.144807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.145590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.146242 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.159838 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] Creating event network-changed:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:07:37.167629 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b9735de6-e784-430c-ba73-113375152bbc req-ae0102a1-3de8-4207-b3d5-f859c306f910 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042006 Oct 03 16:07:37.168556 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 487/948] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:37.210146 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:37.210773 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:37.212768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:37.230151 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=22 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:37.237708 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.242922 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.243615 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.244354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.244845 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.245277 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.477247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:37.490911 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cedb1560-04f6-4188-b175-945f92ce8e33 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.289915 Oct 03 16:07:37.508381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 462/949] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:37 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:37.636274 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:37.641737 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:37.642702 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:37.652149 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.652654 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.653361 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.654122 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.658581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.660125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.720302 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:37.721253 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:37.727909 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.728653 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.729121 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.729829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:37.730420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:37.731032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:37.767844 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:37.777690 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a011604-5bc6-4a57-8485-37ffa24e18b6 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1298 microversion: 2.1 time: 0.142277 Oct 03 16:07:37.778407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 488/950] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:37 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:37.961033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:37.965377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:37.971119 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87661163-93b9-4762-a83c-adeab2f536a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.255077 Oct 03 16:07:37.971792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 463/951] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:37 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:38.515246 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:38.515856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:38.522407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:38.522733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:38.523166 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:38.523854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:38.524300 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:38.524741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:38.708393 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:38.734182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1327fddf-688e-4aa9-b4f9-f3b1400160c0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.222774 Oct 03 16:07:38.735353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 489/952] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:38 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:38.804987 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:38.806329 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:38.813880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:38.814355 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:38.814786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:38.815550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:38.815942 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:38.816361 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:39.000573 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:39.001386 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:39.008655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:39.009476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:39.010172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:39.011209 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:39.011896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:39.012515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:39.061321 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:39.071017 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8179154f-d007-4899-a93c-883380ade58d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.271878 Oct 03 16:07:39.081757 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 464/953] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:38 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:39.251312 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:39.259501 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc5ea7e7-684d-4eba-871d-08dbab9b5b40 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.265714 Oct 03 16:07:39.260476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 490/954] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:38 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:39.551363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ded878-d512-4b70-9de3-49f7dc9b8a56", "tag": "8f31e1a2-5c4a-4399-b704-f794cc1f99d4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:39.564990 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:39.565763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:39.566248 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:39.579555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] Creating event network-changed:8f31e1a2-5c4a-4399-b704-f794cc1f99d4 for instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 on hv-cinder-84456 Oct 03 16:07:39.586527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3cce0b61-b12f-4414-a2f7-73588de1fb8f req-3a0abb12-351d-4cf3-a2af-07684d299deb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039609 Oct 03 16:07:39.587451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 465/955] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:39.758871 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:39.761521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:39.766178 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:39.766734 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:39.767433 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:39.768299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:39.768922 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:39.769626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:40.011462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:40.020331 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-889a8202-7548-4729-9d44-313cfa6259af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.266390 Oct 03 16:07:40.020934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 491/956] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:39 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:40.097072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:40.097843 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:40.104213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:40.104694 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:40.105150 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:40.106073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:40.106529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:40.107517 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:40.237568 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:40.245327 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c28edb9-a85a-48f1-bcee-3eb3efd2186d tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.153087 Oct 03 16:07:40.245892 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 466/957] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:40 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:40.284333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:40.284966 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:40.291062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:40.291535 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:40.291957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:40.292663 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:40.293142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:40.293555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:40.429025 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:40.437818 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad0270c7-5cea-4794-a2b9-b0c9429eb810 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.157246 Oct 03 16:07:40.438314 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 492/958] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:40 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:41.047611 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:41.048393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:41.054622 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.055107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.055734 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.056577 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.057072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.057493 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.267991 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:41.268541 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:41.275132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.275626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.276062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.276776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.277240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.277667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.288665 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:41.297889 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58eccc47-89c1-4573-9877-ecdd59b987f4 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.256428 Oct 03 16:07:41.300761 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 467/959] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:41 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:41.460993 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:41.461598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:41.468217 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.468701 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.469158 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.469851 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.470297 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.470713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.508030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:41.517050 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e741477-be91-4fc5-870d-0f1f1f7d91f3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.252995 Oct 03 16:07:41.530598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 493/960] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:41 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:41.642913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:41.651099 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4d0a87f-92a7-4505-8417-b860600f38e8 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.194402 Oct 03 16:07:41.651668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 468/961] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:41 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:41.810576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e780e0-bcef-4ffd-acd9-5b2e2149670b", "name": "network-vif-plugged", "status": "completed", "tag": "b2a35698-8aad-47ff-b894-6f9f24d5bfad"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:41.820276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:41.820779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:41.821239 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:41.833772 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] Creating event network-vif-plugged:b2a35698-8aad-47ff-b894-6f9f24d5bfad for instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b on hv-cinder-84456 Oct 03 16:07:41.839086 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-dc358464-6d8e-4956-93dc-6cb24d97bef5 req-8a16606c-b590-4239-be1b-3c634990bbb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032479 Oct 03 16:07:41.839683 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 494/962] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:42.320551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:42.321199 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:42.327969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.328452 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.328925 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.329619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.330080 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.330509 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.487534 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:42.495307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce03eeb3-5b8c-4e25-8e50-8eeffe2e22b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.178684 Oct 03 16:07:42.495874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 469/963] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:42 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:42.541963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:42.542779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:42.549223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.549704 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.550146 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.550829 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.551281 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.551700 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.674304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:42.675085 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:42.681068 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.681553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.681934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:42.682072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.682686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:42.683141 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:42.683566 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:42.690088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9248a25f-a8bf-4007-a905-c839ad25e1aa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.153112 Oct 03 16:07:42.690667 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 495/964] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:42 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:42.820048 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:42.828160 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32fdcfe3-92ab-45c6-99fd-7bf2c62f1931 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1266 microversion: 2.1 time: 0.157762 Oct 03 16:07:42.828744 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 470/965] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:42 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:43.522658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:43.523566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:43.531190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.532292 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.533078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.534151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.535038 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.535633 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.718132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:43.719732 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:43.720393 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:43.727576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74994b29-c90d-4e56-b7a7-5cd7da49c743 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.211153 Oct 03 16:07:43.728275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 496/966] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:43 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:43.731102 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.732221 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.732954 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.733908 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.734584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.735231 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.851457 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:43.852177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:43.859973 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.860764 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.861211 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.862030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.862692 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.863318 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.934535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:43.944598 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-145703bc-8a61-45c9-99fd-d832bf6ec54a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.229377 Oct 03 16:07:43.957909 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 471/967] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:43 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:43.967105 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "name": "network-vif-plugged", "status": "completed", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:43.976786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:43.977267 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:43.977694 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:43.990095 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] Creating event network-vif-plugged:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:07:43.995315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a6664740-e468-4be9-a9d5-be2cf02aaeb7 req-ff859487-2dc6-4db5-8fb8-e5fe1739037b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Oct 03 16:07:43.995926 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 472/968] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:44.039127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:44.049950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee19c316-1ca1-4e2a-974a-6aa213cb743a tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1453 microversion: 2.1 time: 0.202378 Oct 03 16:07:44.050540 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 497/969] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:43 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:44.074713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:44.075489 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:44.082407 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.082526 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.082919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:44.083963 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.084419 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.085130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:44.293038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:44.301430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a44648b-d47f-48f1-a473-4bab9ee8f2db tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1453 microversion: 2.1 time: 0.230884 Oct 03 16:07:44.301991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 473/970] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:44 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:44.752767 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:44.753405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:44.760131 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.760632 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.761079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:44.761780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.762232 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.762652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:44.909369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:44.923808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00dcdd67-d986-48de-b5db-7dc33e6a2f43 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1359 microversion: 2.1 time: 0.174898 Oct 03 16:07:44.924565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 498/971] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:44 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:44.972695 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:44.973348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:44.980094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.980702 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.981042 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:44.982326 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:44.983142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:44.983585 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:45.146706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:45.170908 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e445b2ee-d4e3-4368-9eca-b5fd973296a4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.204745 Oct 03 16:07:45.171721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 474/972] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:44 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:45.947310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:45.947945 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:45.955796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:45.956296 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:45.956736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:45.957439 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:45.957889 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:45.958306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.011028 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ded878-d512-4b70-9de3-49f7dc9b8a56", "name": "network-vif-plugged", "status": "completed", "tag": "8f31e1a2-5c4a-4399-b704-f794cc1f99d4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:46.022134 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.023488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.023919 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.036208 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] Creating event network-vif-plugged:8f31e1a2-5c4a-4399-b704-f794cc1f99d4 for instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 on hv-cinder-84456 Oct 03 16:07:46.042311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b69238ad-39c6-410a-bcb0-ee9429f721cb req-4b5c71e1-cd21-4df2-bab9-71542982c410 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Oct 03 16:07:46.042503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 475/973] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:07:46.100175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:46.109288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8b42cb4-7fdb-46ee-85fe-3c7d2ecb39b1 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1548 microversion: 2.1 time: 0.165899 Oct 03 16:07:46.109996 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 499/974] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:45 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:46.132368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:46.133094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:46.139929 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.140668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.141304 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.142002 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.142626 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.143051 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.197043 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:46.198521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:46.208004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.209085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.209598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.210913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.211447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.211965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.408142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:46.423306 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a06a553-870d-43d5-b397-6e1db651805c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1548 microversion: 2.1 time: 0.294743 Oct 03 16:07:46.425387 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 476/975] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:46 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1548 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:46.430765 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e780e0-bcef-4ffd-acd9-5b2e2149670b", "tag": "b2a35698-8aad-47ff-b894-6f9f24d5bfad"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:46.444398 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.445082 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.445666 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.458647 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] Creating event network-changed:b2a35698-8aad-47ff-b894-6f9f24d5bfad for instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b on hv-cinder-84456 Oct 03 16:07:46.464420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-14e45003-fb15-4b0c-8471-3433046799fe req-601c82bd-a4d8-43b6-a794-1bfff9352f65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037305 Oct 03 16:07:46.466503 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 477/976] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:46.466636 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:46.474056 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:46.474466 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-292f9b2b-0f11-4a12-adb1-998658478fa4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.281674 Oct 03 16:07:46.475288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 500/977] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:46 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:46.479252 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:46.480275 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Searching by: {'deleted': False, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 16:07:46.488038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.488913 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.489519 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.490425 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.491052 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.491643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.586675 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 16:07:46.682066 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-828374ef-ead1-443b-bd64-65ad1ddba3d5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213961 Oct 03 16:07:46.682656 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 478/978] 10.222.0.33 () {58 vars in 1125 bytes} [Mon Oct 3 16:07:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:46.694303 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:46.695130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:46.702298 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.702781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.703211 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.703907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:46.704350 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:46.704852 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:46.927797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:46.936942 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7da6dc61-1f89-4d72-b564-e570da30483f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1548 microversion: 2.1 time: 0.246430 Oct 03 16:07:46.937754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 501/979] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:46 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1548 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:47.500247 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:47.501013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:47.508299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:47.509165 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:47.509684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:47.510525 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:47.510983 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:47.511584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:47.646696 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:47.654332 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-38d2823e-1bb6-43ec-bf3f-58eb8cd5f2ce tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1366 microversion: 2.1 time: 0.158813 Oct 03 16:07:47.654906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 479/980] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:47 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:48.515920 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "166b71ca-895c-4264-b7b1-79ce09447021"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:48.518467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:48.524970 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.525524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.526015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.526695 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.527258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.527676 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.677120 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:48.678339 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:48.686825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.687504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.688129 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.689118 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.689736 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.690508 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.798755 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41c1216e-05f7-4232-8774-e558ad9c5f91 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287359 Oct 03 16:07:48.799703 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 502/981] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:07:48 2022] POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:48.855856 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:48.866933 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f0cd6aa-09c1-437f-8163-5d5ebb389a5c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1556 microversion: 2.1 time: 0.193589 Oct 03 16:07:48.867970 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 480/982] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:48 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:07:48.893575 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:48.894404 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:48.915724 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.916228 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.916665 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.917408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:48.917891 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:48.918284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:48.923515 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:49.020860 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c0afb66-b1f5-460c-882e-6a8f11b6e6bb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131351 Oct 03 16:07:49.021592 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 503/983] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:07:48 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:49.998597 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ded878-d512-4b70-9de3-49f7dc9b8a56", "tag": "8f31e1a2-5c4a-4399-b704-f794cc1f99d4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:50.008455 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:50.008958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:50.009379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:50.020488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] Creating event network-changed:8f31e1a2-5c4a-4399-b704-f794cc1f99d4 for instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 on hv-cinder-84456 Oct 03 16:07:50.025842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c4c4d5f5-554f-452e-950e-06e95ddbcc7c req-7f9b7bb2-1a44-40ab-8320-50fa9429b709 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031498 Oct 03 16:07:50.026688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 481/984] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:55.434802 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:55.435400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:55.443293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:55.443775 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:55.444208 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:55.444937 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:55.445391 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:55.445814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:55.580678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:55.589148 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c15d60c3-24f4-4abb-9854-a43a7618ea07 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1594 microversion: 2.1 time: 0.158147 Oct 03 16:07:55.589715 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 504/985] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:55 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:07:57.357763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:57.364057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:57.365204 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:57.369964 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:57.370722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:57.371288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:57.386220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] Creating event network-changed:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:07:57.392629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-57dbb3cc-8a06-402b-be88-84b14cc6fc2d req-1a1615b4-9d8a-49eb-86cf-fdad72aacb35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038979 Oct 03 16:07:57.393237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 482/986] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:07:58.653011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1260312112"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:58.653807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:58.663096 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:58.663902 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:58.664678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:58.665881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:58.666591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:58.667030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:58.866907 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Adding security group 9758de4b-6f77-49e8-a287-d44e32dc2c69 to port 077aebd9-5bf2-430e-8748-15b9e3511bf8 Oct 03 16:07:59.271727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffe90f71-cf12-4d31-9e09-1f172749d0cc tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action" status: 202 len: 0 microversion: 2.1 time: 0.622624 Oct 03 16:07:59.275503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 505/987] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:07:58 2022] POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:07:59.281832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:07:59.282698 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:07:59.294155 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:59.294649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:59.295740 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:59.296447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:59.296930 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:59.298961 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:59.412196 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:07:59.432200 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:07:59.443378 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:07:59.444438 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:07:59.463528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] Creating event network-changed:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:07:59.472189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-02697efb-851c-47f7-af2d-a9918ffc0339 req-2b22cab1-3de1-40a8-81f9-cc5e9297c0d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068045 Oct 03 16:07:59.474310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 506/988] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:07:59.556156 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:07:59.566610 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-08302cbf-244a-49ad-92d4-54af33f8639b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1759 microversion: 2.1 time: 0.289077 Oct 03 16:07:59.567739 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 483/989] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:07:59 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1759 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:02.603976 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-404874323", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:02.610932 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=56 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:02.657053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:08:02.922714 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:08:02.923136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:08:02.923610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:08:02.924016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:08:02.924420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:08:02.933296 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:02.933776 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:02.934206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:02.934922 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:02.935431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:02.935985 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:02.953280 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Getting quotas for project f63f9a22c695451da76e8794f1b6a7a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:08:02.957356 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Getting quotas for user 3467cd26ac30452eb0e9004903313525 and project f63f9a22c695451da76e8794f1b6a7a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:08:02.969190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:08:02.971588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:08:03.020983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0aa8bb2-7578-4137-8847-33a35ae49f3a tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421503 Oct 03 16:08:03.021668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 507/990] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:08:03.033420 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f9941c-3e5f-48bd-8484-e2dcce9d07c6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:03.034033 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6f9941c-3e5f-48bd-8484-e2dcce9d07c6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:03.091821 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6f9941c-3e5f-48bd-8484-e2dcce9d07c6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:03.098738 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6f9941c-3e5f-48bd-8484-e2dcce9d07c6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1214 microversion: 2.1 time: 0.070018 Oct 03 16:08:03.099298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 484/991] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:03 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:04.122030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:04.122627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:04.130648 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:04.131130 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:04.131565 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:04.132254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:04.132708 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:04.133154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:04.463429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:04.472177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-596f99bc-2cc5-4a6b-ba6a-93add7737d39 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1266 microversion: 2.1 time: 0.354426 Oct 03 16:08:04.472988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 508/992] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:04 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:05.495281 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:05.495770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:05.504054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:05.504535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:05.504997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:05.505690 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:05.506140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:05.506591 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:05.510830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:05.715004 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:05.723154 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8656b586-8b00-4d48-b091-c79466913a33 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.231977 Oct 03 16:08:05.723722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 485/993] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:05 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:05.963766 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3bc030-93ba-4e61-b6a2-38ddc87fb68c", "tag": "7203e4aa-8d6b-406d-9a93-be5a24c9293a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:05.974797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:05.975273 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:05.975688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:05.987058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] Creating event network-changed:7203e4aa-8d6b-406d-9a93-be5a24c9293a for instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c on hv-cinder-84456 Oct 03 16:08:05.991752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f80891e5-202b-4a76-a3b6-13634ef50961 req-e37ff747-019d-4904-bfb6-16d8a8fb547e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Oct 03 16:08:05.992347 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 509/994] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:08:06.745740 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:06.746345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:06.753510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:06.754014 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:06.754444 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:06.755123 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:06.755574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:06.755994 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:06.893037 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:06.900801 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-636f9023-f1fa-4b17-b8bb-642afc0ab642 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.158983 Oct 03 16:08:06.901365 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 486/995] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:06 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:07.925156 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:07.925846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:07.931975 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:07.932446 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:07.932910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:07.933587 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:07.934034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:07.934452 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:08.062729 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:08.070413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd1abd2b-0ff4-48df-9133-4c55ddefbc57 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.150759 Oct 03 16:08:08.070971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 510/996] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:07 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:09.099409 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:09.100044 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:09.106689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:09.107692 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:09.108127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:09.108874 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:09.109334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:09.109751 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:09.236179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:09.243786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dcee433f-275d-4b7e-a8ee-bb35812d32f6 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.148357 Oct 03 16:08:09.244347 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 487/997] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:09 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:10.267841 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:10.268415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:10.274952 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:10.275423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:10.275850 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:10.277013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:10.277013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:10.277553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:10.412002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:10.420107 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3eed3083-14f9-4d21-a951-acfe2ce95900 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.156478 Oct 03 16:08:10.420560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 511/998] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:10 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:11.442967 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:11.443574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:11.450070 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:11.450544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:11.451309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:11.451997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:11.452450 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:11.452901 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:11.586619 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:11.595415 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34a84a9e-37e8-49be-a7b4-39b47848787e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.156260 Oct 03 16:08:11.596028 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 488/999] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:11 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:11.697074 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3bc030-93ba-4e61-b6a2-38ddc87fb68c", "name": "network-vif-plugged", "status": "completed", "tag": "7203e4aa-8d6b-406d-9a93-be5a24c9293a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:11.707407 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:11.708503 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:11.708989 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:11.720450 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] Creating event network-vif-plugged:7203e4aa-8d6b-406d-9a93-be5a24c9293a for instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c on hv-cinder-84456 Oct 03 16:08:11.725337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-22009391-0922-4b5e-a2bd-207f177e6178 req-28e78d14-c144-4042-9567-5ca88cf368d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Oct 03 16:08:11.726098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 512/1000] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:12.618817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:12.619425 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:12.625790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:12.626266 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:12.626699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:12.627377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:12.627836 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:12.628238 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:12.754377 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:12.762020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4415d49-ae79-4764-a3e0-bd3a4b7deaa8 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1314 microversion: 2.1 time: 0.147056 Oct 03 16:08:12.762581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 489/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:12 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:13.786123 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:13.786741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:13.789257 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:13.790058 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:13.796815 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:13.797306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:13.797745 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:13.798443 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:13.798899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:13.799327 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:13.933009 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:13.940750 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7e1219d-3cd4-47a9-afc9-b3d926012984 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1464 microversion: 2.1 time: 0.158902 Oct 03 16:08:13.941326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 513/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:13 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:13.987439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:13.987938 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:13.989805 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:13.995378 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:13.995853 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:13.996282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:13.996997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:13.997443 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:13.997861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:14.022809 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:08:14.098551 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c99f1a1-1eec-478d-966e-6de696bb5aa2 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 204 len: 0 microversion: 2.1 time: 0.114297 Oct 03 16:08:14.099560 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 490/1003] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:08:13 2022] DELETE /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 16:08:14.107635 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:14.108382 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:14.114367 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:14.114843 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:14.115272 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:14.115961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:14.116409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:14.116854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:14.246999 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:14.255429 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-875c4f2d-3975-4334-94c8-8e88ddcb6766 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1470 microversion: 2.1 time: 0.151661 Oct 03 16:08:14.256005 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 514/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:14 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:15.280426 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:15.281220 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:15.287748 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:15.288234 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:15.288735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:15.289432 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:15.289880 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:15.290300 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:15.422960 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:15.430852 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3baf481c-3f2a-43c5-b5c5-bd6ad7fa711c tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1470 microversion: 2.1 time: 0.155523 Oct 03 16:08:15.431412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 491/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:15 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:16.260092 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3bc030-93ba-4e61-b6a2-38ddc87fb68c", "name": "network-vif-deleted", "tag": "7203e4aa-8d6b-406d-9a93-be5a24c9293a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:16.272591 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:16.273197 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:16.273696 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:16.451562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] Creating event network-vif-deleted:7203e4aa-8d6b-406d-9a93-be5a24c9293a for instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c on hv-cinder-84456 Oct 03 16:08:16.454630 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:16.455246 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:16.458577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-88db10c0-0752-447d-899d-08fc4d534dc1 req-1c0ed442-3cc3-4f9d-a42a-234e6ac93349 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202626 Oct 03 16:08:16.459915 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 515/1006] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:16.463094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:16.464957 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:16.465540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:16.466296 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:16.467677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:16.468284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:16.502122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:16.502806 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:16.503237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:16.503671 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lazy-loading 'fault' on Instance uuid 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:08:16.548154 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467cd26ac30452eb0e9004903313525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f9a22c695451da76e8794f1b6a7a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:16.556063 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-317b3024-9651-4d1e-b7dd-cd7a7be09667 tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 200 len: 1304 microversion: 2.1 time: 0.106039 Oct 03 16:08:16.556616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 492/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:16 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:17.581031 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:17.581652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] [instance: 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:17.588533 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:17.589032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:17.589462 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:17.590142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:17.590589 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:17.591004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:17.604016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] HTTP exception thrown: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Request method failure captured: Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c HTTP/1.1 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwjhtKDAxGEoeGqnC3H25ncv-UcywvRBHByoVgOhmCTCk9LNvuvthAqXihPgWOT0ZZXYWPcAGD-1xyyPEXXeopFjj0oZS7hn0RbL1B_qGTuGDqQUGNYhHOvPu45TjcUJiClHUUUbcy2pdMRQLNypP4WD5se5UadB8TobEBZnm1y-epk Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: f63f9a22c695451da76e8794f1b6a7a9 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1420013560 Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:08:17.605628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f63f9a22c695451da76e8794f1b6a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f63f9a22c695451da76e8794f1b6a7a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f63f9a22c695451da76e8794f1b6a7a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f63f9a22c695451da76e8794f1b6a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1420013560 Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f63f9a22c695451da76e8794f1b6a7a9 Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1420013560 Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1420013560-project Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 3467cd26ac30452eb0e9004903313525 Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1420013560-project Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. Oct 03 16:08:17.607866 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '6e3bc030-93ba-4e61-b6a2-38ddc87fb68c'} Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:08:17.609498 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. Oct 03 16:08:17.611095 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:08:17.612615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] Returning 404 to user: Instance 6e3bc030-93ba-4e61-b6a2-38ddc87fb68c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:08:17.612615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5872180-bd2e-408a-8e6a-35095ae11c8e tempest-VolumesNegativeTest-1420013560 tempest-VolumesNegativeTest-1420013560-project] 10.222.0.33 "GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c" status: 404 len: 111 microversion: 2.1 time: 0.031043 Oct 03 16:08:17.612615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 516/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:17 2022] GET /compute/v2.1/servers/6e3bc030-93ba-4e61-b6a2-38ddc87fb68c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:08:25.155882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:25.158232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:25.165116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:25.165599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:25.166036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:25.166730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:25.167299 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:25.167729 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:25.242381 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-648bf849-2808-44f8-bdeb-91c792a1aa0a tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action" status: 202 len: 0 microversion: 2.1 time: 0.090971 Oct 03 16:08:25.243000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 493/1009] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:08:25 2022] POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:08:25.252147 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:25.252791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:25.259596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:25.260082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:25.260518 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:25.261379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:25.261826 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:25.262256 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:25.267352 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=55 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:25.496875 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:25.505449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0f2c235-4638-4002-9334-f2ccde6a95a2 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1751 microversion: 2.1 time: 0.258083 Oct 03 16:08:25.506007 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 517/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:25 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:26.233351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:26.233931 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:26.240154 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:26.240627 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:26.241077 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:26.241749 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:26.242197 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:26.242608 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:26.267016 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60d55fbf-fe28-4c31-8188-b6ff62dd49cb tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/ips" status: 200 len: 150 microversion: 2.1 time: 0.038426 Oct 03 16:08:26.267569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 494/1011] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:08:26 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:26.543705 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:26.544379 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:26.551365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:26.551846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:26.552276 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:26.552997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:26.553445 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:26.553865 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:26.696558 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:26.705094 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b542a980-e27b-4840-a515-4c8e5cb6bd3c tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.180165 Oct 03 16:08:26.705661 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 518/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:26 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:27.600770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91bc8747-9459-4bdb-ba5e-176eed2b684f"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:27.603061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:27.609292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:27.609760 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:27.610187 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:27.610860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:27.611307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:27.611724 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:27.729195 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:27.729799 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:27.736444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:27.737172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:27.737602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:27.738290 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:27.738742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:27.739173 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:27.856542 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c140fbc2-c81e-4d26-95fd-3a469123ffef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259698 Oct 03 16:08:27.857531 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 495/1013] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:08:27 2022] POST /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:27.902349 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:27.911054 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1e15303-067c-49f6-8609-c94d1afe1250 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.185675 Oct 03 16:08:27.911618 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 519/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:27 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:28.936195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:28.936907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:28.943228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:28.943706 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:28.944232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:28.944977 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:28.945428 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:28.945850 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:29.087291 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:29.095816 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c8b106a-4f18-438e-bf87-034b97424ca0 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.164696 Oct 03 16:08:29.096376 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 496/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:28 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:30.119389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:30.120023 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:30.126646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:30.127125 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:30.127555 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:30.128233 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:30.128683 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:30.129133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:30.273684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:30.282424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efa021ec-77b8-49c2-abe8-ad04d569e0aa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.166925 Oct 03 16:08:30.282979 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 520/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:30 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:31.306272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:31.306788 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:31.309202 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:31.315348 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:31.315837 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:31.316264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:31.316986 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:31.317434 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:31.317854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:31.459352 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:31.462782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:31.468777 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-843b5d30-dff3-4ed7-a554-294fcdeb69af tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.166490 Oct 03 16:08:31.469345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 497/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:31 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:32.492394 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:32.492956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:32.500260 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:32.500765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:32.501206 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:32.501906 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:32.502389 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:32.502817 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:32.640749 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:32.648998 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9a2a44e-7751-4f0d-9171-a4ee0e3422be tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.160527 Oct 03 16:08:32.649564 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 521/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:32 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:33.673075 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:33.673680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:33.681207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:33.681685 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:33.682115 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:33.682792 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:33.683261 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:33.683678 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:33.835861 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:33.845487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93d4e3e1-84ee-42df-b159-ea8b73bbfc22 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.177007 Oct 03 16:08:33.846400 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 498/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:33 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:34.869135 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:34.869740 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:34.872030 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:34.877523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:34.877997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:34.878424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:34.879106 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:34.879553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:34.879971 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.024164 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:35.033588 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-564ed51a-1153-4394-bda1-5224b5affd1b tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.168296 Oct 03 16:08:35.034139 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 522/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:34 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:35.406154 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91bc8747-9459-4bdb-ba5e-176eed2b684f"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:35.408555 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:35.415103 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.415572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.415999 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.416662 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.417134 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.417547 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.495550 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments HTTP/1.1 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 74 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:08:35.498046 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "91bc8747-9459-4bdb-ba5e-176eed2b684f"}} Oct 03 16:08:35.499684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'server_id': 'c5ded878-d512-4b70-9de3-49f7dc9b8a56', 'body': {'volumeAttachment': {'volumeId': '91bc8747-9459-4bdb-ba5e-176eed2b684f'}}} Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:35.500601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:35.501882 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 400 to user: Invalid volume: volume 91bc8747-9459-4bdb-ba5e-176eed2b684f is already attached to instances: c5ded878-d512-4b70-9de3-49f7dc9b8a56 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed30bff9-48c1-40c4-b09a-182e7e30a696 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097393 Oct 03 16:08:35.503164 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 499/1021] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:08:35 2022] POST /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:08:35.563880 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:35.564408 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:35.570477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.570960 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.571398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.572088 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.572542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.573017 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.659220 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'services' on Instance uuid c5ded878-d512-4b70-9de3-49f7dc9b8a56 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:08:35.730174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c193882e-3e75-4dc4-9571-f638262daff0 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments/91bc8747-9459-4bdb-ba5e-176eed2b684f" status: 202 len: 0 microversion: 2.1 time: 0.170598 Oct 03 16:08:35.730754 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 523/1022] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:08:35 2022] DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments/91bc8747-9459-4bdb-ba5e-176eed2b684f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:08:35.739807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:35.742038 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:35.749451 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.749980 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.750351 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.751034 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:35.751481 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:35.751904 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:35.782105 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fcb5b1bb-4ab7-4fd5-808a-b101f009a3f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Oct 03 16:08:35.782664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 500/1023] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:08:35 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:36.058796 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:36.059406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:36.065580 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:36.066052 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:36.066479 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:36.067153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:36.067604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:36.068016 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:36.214369 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:36.223217 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13039141-9119-4e24-b08e-de9e923b3cc8 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1756 microversion: 2.1 time: 0.169158 Oct 03 16:08:36.223773 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 524/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:36 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:36.795920 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:36.798030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:36.804422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:36.804928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:36.805354 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:36.806047 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:36.806487 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:36.806899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:36.838078 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-300116cf-3222-4944-ba4e-2166aba7d0f4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Oct 03 16:08:36.838629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 501/1025] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:08:36 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:37.246881 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:37.247775 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:37.255319 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.255801 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.256235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.256959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.257414 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.257935 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.398864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:37.408048 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4be77506-c273-4ba8-9635-3e9af62a9556 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1759 microversion: 2.1 time: 0.165131 Oct 03 16:08:37.408615 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 525/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:37 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:37.851268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:37.853416 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:37.860025 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.860539 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.861007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.861699 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.862152 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.862604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.891946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b866352-5d15-4afe-98e9-7a274da32d7e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044633 Oct 03 16:08:37.892498 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 502/1027] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:08:37 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:08:37.954301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:37.954797 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:37.961044 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.961530 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.961965 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.962646 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:37.963101 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:37.963523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:37.988180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:08:38.062448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8905675a-21e2-4e94-a731-478f371b5987 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 204 len: 0 microversion: 2.1 time: 0.112252 Oct 03 16:08:38.063136 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 526/1028] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:08:37 2022] DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:08:38.071581 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:38.072198 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:38.078742 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:38.079223 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:38.079667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:38.080355 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:38.080864 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:38.081292 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:38.209974 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:38.217968 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf508613-9e5f-4a4f-9963-af4f892e3ec4 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1681 microversion: 2.1 time: 0.150355 Oct 03 16:08:38.218540 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 503/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:38 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:39.242098 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:39.242711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:39.249885 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:39.250362 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:39.250790 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:39.251471 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:39.251916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:39.252332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:39.385858 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:39.393863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce9ab7e9-3d6f-4314-9a3d-373aaddfb19a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1681 microversion: 2.1 time: 0.156188 Oct 03 16:08:39.394422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 527/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:39 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:40.417076 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:40.417677 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:40.424674 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:40.425161 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:40.425593 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:40.426272 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:40.426712 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:40.427163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:40.658447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:40.666382 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3bbc6aa-09f8-4adf-b6a9-e71d800f9e0a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 200 len: 1681 microversion: 2.1 time: 0.253258 Oct 03 16:08:40.667053 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 504/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:40 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:40.873722 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ded878-d512-4b70-9de3-49f7dc9b8a56", "name": "network-vif-deleted", "tag": "8f31e1a2-5c4a-4399-b704-f794cc1f99d4"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:40.888013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:40.888553 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:40.889370 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:40.906182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] Creating event network-vif-deleted:8f31e1a2-5c4a-4399-b704-f794cc1f99d4 for instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 on hv-cinder-84456 Oct 03 16:08:40.912154 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-501940ea-0246-4a0e-82f3-974912753921 req-c721ab5a-d7a5-45fa-947e-5dcf0022262d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041631 Oct 03 16:08:40.913013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 528/1032] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:41.691117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:41.691942 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:41.698624 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:41.699107 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:41.699537 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:41.700239 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:41.700684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:41.701130 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:41.715992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 HTTP/1.1 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:08:41.717721 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:08:41.719430 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'c5ded878-d512-4b70-9de3-49f7dc9b8a56'} Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:08:41.720541 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:08:41.722181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:08:41.723681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:08:41.723681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32597b7a-0751-419f-8b3e-4cf6521e247e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 404 len: 111 microversion: 2.1 time: 0.031921 Oct 03 16:08:41.723681 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 505/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:41 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:08:41.728467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8b61df5-3e89-48f4-9388-18e8042da158 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '.version_select at 0x7f81785adca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:41.762221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8b61df5-3e89-48f4-9388-18e8042da158 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359432975" status: 202 len: 0 microversion: 2.1 time: 0.026004 Oct 03 16:08:41.764566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 529/1034] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359432975 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:08:42.612336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd92d65f-1314-405a-ab7d-eb06596226a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: .version_select at 0x7f8174dd3d30>, body: {"keypair": {"name": "tempest-keypair-958535874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL52vqPLzP8J75jmgmcGI+5SJGBt4z7p/c1cmIVSrfH3WBRGsuND5AURBQhtCQjwxu5B5HKSjYWKKEw8tGawB7wR6k3sknzXxETo++kd5FzBrNfThQ5F8lL0JBtgoOXvwg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:42.628315 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-bd92d65f-1314-405a-ab7d-eb06596226a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:08:42.632179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-bd92d65f-1314-405a-ab7d-eb06596226a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:08:42.653894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd92d65f-1314-405a-ab7d-eb06596226a3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045512 Oct 03 16:08:42.654480 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 506/1035] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Oct 3 16:08:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:43.888595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-902195050", "imageRef": "51b9ada8-17df-447f-908d-f250e55f25b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b5f831-720b-4bbf-8b1b-0fa2209326c5"}], "security_groups": [{"name": "tempest-securitygroup--1506782456"}], "key_name": "tempest-keypair-958535874", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:43.991585 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] validate_networks() for [('87b5f831-720b-4bbf-8b1b-0fa2209326c5', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:08:44.360275 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:08:44.360687 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:08:44.361177 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:08:44.361576 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:08:44.362004 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:08:44.370712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:44.371180 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:44.371605 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:44.372322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:44.372798 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:44.373219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:44.389350 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:08:44.393271 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Getting quotas for user 4cc1db8ef8c44763a0e5f62a3404a834 and project 62932ad37df941b1840b183a858c7876. Resources: {'ram', 'instances', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:08:44.404622 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:08:44.406980 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51b9ada8-17df-447f-908d-f250e55f25b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:08:44.453627 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a66ba215-ae64-4544-9aac-0ec38b0bfd5a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569907 Oct 03 16:08:44.454265 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 530/1036] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Oct 3 16:08:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:08:44.466063 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d0d8d28-85d9-45f3-a06f-afb2fa6b8aa2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:44.466770 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d0d8d28-85d9-45f3-a06f-afb2fa6b8aa2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:44.521958 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d0d8d28-85d9-45f3-a06f-afb2fa6b8aa2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:44.529860 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d0d8d28-85d9-45f3-a06f-afb2fa6b8aa2 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1240 microversion: 2.1 time: 0.068244 Oct 03 16:08:44.530412 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 507/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:44 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:45.553739 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:45.554384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:45.562997 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:45.563491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:45.563923 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:45.564643 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:45.565129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:45.565570 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:45.645236 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:45.653835 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c16b4927-f4ac-4b25-b711-71704931aa59 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1310 microversion: 2.1 time: 0.104058 Oct 03 16:08:45.654706 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 531/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:45 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:46.677700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:46.678369 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:46.685807 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:46.686298 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:46.686730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:46.687421 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:46.687866 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:46.688283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:46.887718 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:46.896171 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e30c1e3-e537-4784-b1dc-99b4131b8dd3 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.222313 Oct 03 16:08:46.897209 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 508/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:46 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:08:46.993913 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ba4b3d-c2d4-438b-83fc-b4fad378d66d", "tag": "eae060f4-2959-4b95-8e8f-78604da0114e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:47.006523 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:47.007134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:47.007598 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:47.023385 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] Creating event network-changed:eae060f4-2959-4b95-8e8f-78604da0114e for instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d on hv-cinder-84456 Oct 03 16:08:47.031157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-28f62f85-b4db-4f24-8271-b9178b18a98d req-3218a366-e8ba-4eea-9012-5404b6c580fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040577 Oct 03 16:08:47.031793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 532/1040] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:08:47.920996 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:47.921583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:47.927988 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:47.928462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:47.928928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:47.929604 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:47.930109 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:47.930456 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:48.063280 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:48.070982 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c5df6ab-a72c-4c03-89aa-da231898ec69 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.154727 Oct 03 16:08:48.071563 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 509/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:47 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:49.094293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:49.094983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:49.101892 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:49.102365 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:49.102799 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:49.103476 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:49.103921 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:49.104336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:49.239473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:49.247713 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-526765a2-7950-43a5-ad6e-4bea55702d4f tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.157697 Oct 03 16:08:49.248284 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 533/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:49 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:50.269520 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:50.270140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:50.276535 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:50.277034 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:50.277965 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:50.278780 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:50.279228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:50.279649 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:50.409692 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:50.417344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51efeb94-f44e-4b3b-8e7f-12b5ccb807a5 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.151685 Oct 03 16:08:50.417915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 510/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:50 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:51.440398 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:51.441032 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:51.447593 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:51.448078 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:51.448513 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:51.449235 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:51.450490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:51.450924 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:51.467121 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:51.587500 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:51.596055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c70caf0a-1df8-4fa4-9a1d-d92f11490c3b tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.159498 Oct 03 16:08:51.596621 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 534/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:51 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:52.618367 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:52.618985 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:52.626264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:52.626779 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:52.627224 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:52.628087 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:52.628728 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:52.629336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:52.766680 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:52.774263 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee7f6596-9f85-44ba-b931-301a01351675 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.159868 Oct 03 16:08:52.774822 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 511/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:52 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:53.797070 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:53.797712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:53.804127 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:53.804607 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:53.805073 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:53.805763 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:53.806212 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:53.806628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:53.941477 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:53.945854 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ba4b3d-c2d4-438b-83fc-b4fad378d66d", "name": "network-vif-plugged", "status": "completed", "tag": "eae060f4-2959-4b95-8e8f-78604da0114e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:53.951183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27e61cb8-9bad-494d-a8e1-c635d9208999 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.157828 Oct 03 16:08:53.951988 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 535/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:53 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:53.956429 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:53.956840 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:53.957249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:53.969213 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] Creating event network-vif-plugged:eae060f4-2959-4b95-8e8f-78604da0114e for instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d on hv-cinder-84456 Oct 03 16:08:53.974007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4ebcf2a4-62b9-4282-b727-a4284185b4a4 req-1788b72e-a8a7-47e6-8001-9c5fcad7ce38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032127 Oct 03 16:08:53.974747 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 512/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:08:54.975467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:54.976082 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:54.977983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:54.978678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:54.986140 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:54.986628 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:54.987073 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:54.987769 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:54.988224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:54.988655 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:55.115725 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:55.123899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a6216d6-66c7-45e8-a8aa-2c4a4f487abf tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1366 microversion: 2.1 time: 0.152350 Oct 03 16:08:55.124464 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 536/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:54 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:56.143491 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:56.148055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:56.148763 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:56.155136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.155602 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.156023 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.156693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.157159 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.157572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.287573 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:56.295941 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9a73ef0-9bfe-435c-b041-72a5c340f337 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1555 microversion: 2.1 time: 0.153380 Oct 03 16:08:56.296506 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 513/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:56 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:56.318521 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:56.319065 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:56.326400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.326581 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.327008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.327689 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.328132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.328547 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.409241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-183c4209-0ba9-4a2e-8fbe-c4caa74d822a tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094466 Oct 03 16:08:56.409837 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 537/1050] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Oct 3 16:08:56 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:57.618682 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ba4b3d-c2d4-438b-83fc-b4fad378d66d", "tag": "eae060f4-2959-4b95-8e8f-78604da0114e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:57.628636 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:57.629232 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:57.629758 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:57.641309 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] Creating event network-changed:eae060f4-2959-4b95-8e8f-78604da0114e for instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d on hv-cinder-84456 Oct 03 16:08:57.646090 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-00a6e171-e233-46e2-bc9c-6c19c08a1976 req-c82165d4-7c94-4533-b733-9cba7144ec96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Oct 03 16:08:57.646700 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 514/1051] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:09.674512 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:09.675258 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=19 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:09.679625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1260312112"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:09.680159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:09.688340 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:09.688854 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:09.689288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:09.689974 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:09.690424 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:09.690845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:09.997610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Removing security group 9758de4b-6f77-49e8-a287-d44e32dc2c69 from port 077aebd9-5bf2-430e-8748-15b9e3511bf8 Oct 03 16:09:10.306669 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5cc6f9ed-5451-4611-9f70-f788ba4e8a3d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action" status: 202 len: 0 microversion: 2.1 time: 0.633595 Oct 03 16:09:10.307355 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 538/1052] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Oct 3 16:09:09 2022] POST /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:10.317032 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:10.328641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:10.329486 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=78 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:10.332488 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:10.333308 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:10.334242 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:10.348966 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] Creating event network-changed:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:09:10.355314 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-77850e2c-89b6-4510-b4a5-e7c107257d62 req-7d7c20d5-b3da-4561-a9f6-171e711b1bf9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042757 Oct 03 16:09:10.357270 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 515/1053] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:11.607405 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:11.607940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:11.613847 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:11.614334 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:11.614781 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:11.615455 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:11.615905 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:11.616322 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:11.699447 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lazy-loading 'services' on Instance uuid af50d6bd-102c-4df2-89f7-717edf01d8db {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:09:11.781288 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-024ae369-d40c-4d7e-b50e-c207494fad2f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments/166b71ca-895c-4264-b7b1-79ce09447021" status: 202 len: 0 microversion: 2.1 time: 0.178678 Oct 03 16:09:11.781919 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 539/1054] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:09:11 2022] DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments/166b71ca-895c-4264-b7b1-79ce09447021 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:11.790782 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:11.793084 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:11.802496 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:11.802951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:11.803621 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:11.804504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:11.804991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:11.805445 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:11.837422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cdccc64-92fc-47e6-8cd1-14d26dc5a65d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050927 Oct 03 16:09:11.837992 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 516/1055] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:09:11 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:12.373062 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:12.383042 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:12.383825 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:12.384448 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:12.396940 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] Creating event network-changed:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:09:12.401981 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cf930f5f-06a3-4100-813d-7c3a0ad5f985 req-6334b276-29c8-43a7-90f1-85af124e1d1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033310 Oct 03 16:09:12.402577 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 540/1056] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:12.850903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:12.853088 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:12.859918 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:12.860469 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:12.861009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:12.861773 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:12.862333 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:12.862753 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:12.893307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d625900e-77b4-41ff-81e7-d23caab458f6 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046239 Oct 03 16:09:12.894194 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 517/1057] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:09:12 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:09:12.904987 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:12.905569 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:12.912436 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:12.913161 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:12.913791 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:12.914652 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:12.915264 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:12.915843 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:12.995926 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] HTTP exception thrown: Instance af50d6bd-102c-4df2-89f7-717edf01d8db is not attached to volume 166b71ca-895c-4264-b7b1-79ce09447021 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Request method failure captured: Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments/166b71ca-895c-4264-b7b1-79ce09447021 HTTP/1.1 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwiqqhmvFVSvyuEOtDenYIRr62Grmdax0WgHA6h9TYWn1-srxzcb3FcXPfxLbvylEVzigCjBOxCbjZHZi9moHMYB144id4gaafm6FXW5NDCE7aQGrZ95LrV_7TdRwzlT_gmBBVmdljofbDPH5L-ZkcbLyzSALhyyJIrqz84YcmCh7Lw Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: a7ffe330a5d2482e961c93077d13cc5b Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:12.999444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7ffe330a5d2482e961c93077d13cc5b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: a7ffe330a5d2482e961c93077d13cc5b Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestMinimumBasicScenario-1481528375-project Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7fe42f8d88c540418580fb8c668bf2de Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestMinimumBasicScenario-1481528375-project Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:13.001201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance af50d6bd-102c-4df2-89f7-717edf01d8db is not attached to volume 166b71ca-895c-4264-b7b1-79ce09447021 Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'server_id': 'af50d6bd-102c-4df2-89f7-717edf01d8db', 'id': '166b71ca-895c-4264-b7b1-79ce09447021'} Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 166b71ca-895c-4264-b7b1-79ce09447021. Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:13.001984 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af50d6bd-102c-4df2-89f7-717edf01d8db is not attached to volume 166b71ca-895c-4264-b7b1-79ce09447021 Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af50d6bd-102c-4df2-89f7-717edf01d8db is not attached to volume 166b71ca-895c-4264-b7b1-79ce09447021 Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:13.003326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Returning 404 to user: Instance af50d6bd-102c-4df2-89f7-717edf01d8db is not attached to volume 166b71ca-895c-4264-b7b1-79ce09447021 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:13.004332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9df257c1-8eac-463e-a626-b8c7d01edd0d tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments/166b71ca-895c-4264-b7b1-79ce09447021" status: 404 len: 154 microversion: 2.1 time: 0.100253 Oct 03 16:09:13.004332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 541/1058] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:09:12 2022] DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db/os-volume_attachments/166b71ca-895c-4264-b7b1-79ce09447021 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:14.149214 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:14.149715 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:14.156750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:14.157234 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:14.157666 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:14.158345 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:14.158794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:14.159211 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:14.183945 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:09:14.258841 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76773915-6818-4fb0-b16e-0a40ee4e73fa tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 204 len: 0 microversion: 2.1 time: 0.113118 Oct 03 16:09:14.259709 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 518/1059] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:14 2022] DELETE /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:09:14.269218 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:14.269831 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:14.275930 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:14.276410 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:14.276908 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:14.277601 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:14.278064 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:14.278488 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:14.407159 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:14.414845 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20b73582-1d06-4e6e-a331-3c05a86dfb04 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1554 microversion: 2.1 time: 0.150205 Oct 03 16:09:14.415406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 542/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:14 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:15.439310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:15.440013 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:15.446532 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:15.447009 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:15.447439 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:15.448124 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:15.448572 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:15.449020 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:15.907402 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:15.915125 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90af0407-009c-42b0-a579-ad8dcb5b112f tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1554 microversion: 2.1 time: 0.480936 Oct 03 16:09:15.915684 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 519/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:15 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1554 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:16.600748 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af50d6bd-102c-4df2-89f7-717edf01d8db", "name": "network-vif-deleted", "tag": "077aebd9-5bf2-430e-8748-15b9e3511bf8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:16.610780 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:16.611254 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:16.611680 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:16.623083 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] Creating event network-vif-deleted:077aebd9-5bf2-430e-8748-15b9e3511bf8 for instance af50d6bd-102c-4df2-89f7-717edf01d8db on hv-cinder-84456 Oct 03 16:09:16.627888 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2ea5b670-2832-4b7f-8fd0-ab945d094c83 req-73742aed-d3de-4306-b6c1-3a6af0c06755 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030808 Oct 03 16:09:16.628442 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 543/1062] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:16.938127 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:16.938669 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:16.946094 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:16.946579 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:16.947008 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:16.947710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:16.948163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:16.949116 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:16.985768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:16.986254 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:16.986686 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:16.987132 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lazy-loading 'fault' on Instance uuid af50d6bd-102c-4df2-89f7-717edf01d8db {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:09:17.028561 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe42f8d88c540418580fb8c668bf2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ffe330a5d2482e961c93077d13cc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:17.036454 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccbdf163-0c77-48eb-964e-3af5225966cd tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 200 len: 1349 microversion: 2.1 time: 0.102620 Oct 03 16:09:17.036989 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 520/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:16 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:18.061237 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:18.061941 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] [instance: af50d6bd-102c-4df2-89f7-717edf01d8db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:18.068087 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:18.068559 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:18.069034 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:18.069728 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:18.070176 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:18.070596 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:18.084972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] HTTP exception thrown: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Request method failure captured: Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db HTTP/1.1 Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwiqqhmvFVSvyuEOtDenYIRr62Grmdax0WgHA6h9TYWn1-srxzcb3FcXPfxLbvylEVzigCjBOxCbjZHZi9moHMYB144id4gaafm6FXW5NDCE7aQGrZ95LrV_7TdRwzlT_gmBBVmdljofbDPH5L-ZkcbLyzSALhyyJIrqz84YcmCh7Lw Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: a7ffe330a5d2482e961c93077d13cc5b Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:18.086668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7ffe330a5d2482e961c93077d13cc5b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7ffe330a5d2482e961c93077d13cc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: a7ffe330a5d2482e961c93077d13cc5b Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1481528375 Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestMinimumBasicScenario-1481528375-project Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7fe42f8d88c540418580fb8c668bf2de Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestMinimumBasicScenario-1481528375-project Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. Oct 03 16:09:18.088313 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'af50d6bd-102c-4df2-89f7-717edf01d8db'} Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:18.089453 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. Oct 03 16:09:18.091189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:18.092808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Returning 404 to user: Instance af50d6bd-102c-4df2-89f7-717edf01d8db could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:18.092808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae8fb522-28d8-4cf7-ae82-862394fe1572 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db" status: 404 len: 111 microversion: 2.1 time: 0.032021 Oct 03 16:09:18.092808 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 544/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:18 2022] GET /compute/v2.1/servers/af50d6bd-102c-4df2-89f7-717edf01d8db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:18.097000 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2905cfbc-769f-402d-ac94-cd022eb3aff5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] Calling method '.version_select at 0x7f8174ed9700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:18.115616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2905cfbc-769f-402d-ac94-cd022eb3aff5 tempest-TestMinimumBasicScenario-1481528375 tempest-TestMinimumBasicScenario-1481528375-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1261642195" status: 202 len: 0 microversion: 2.1 time: 0.022338 Oct 03 16:09:18.116205 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 521/1065] 10.222.0.33 () {58 vars in 1272 bytes} [Mon Oct 3 16:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1261642195 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:26.215861 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:26.222693 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e780e0-bcef-4ffd-acd9-5b2e2149670b", "tag": "b2a35698-8aad-47ff-b894-6f9f24d5bfad"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:26.223240 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:26.230324 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:26.230899 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:26.231972 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:26.232684 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:26.233431 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:26.233597 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:26.235179 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:26.235731 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:26.236237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:26.247379 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] Creating event network-changed:b2a35698-8aad-47ff-b894-6f9f24d5bfad for instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b on hv-cinder-84456 Oct 03 16:09:26.252802 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3b4d11ec-c51d-465b-9a79-afb432d542bd req-cdd078fb-568a-4910-b354-dce0f760d38b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Oct 03 16:09:26.253490 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 522/1066] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:26.264469 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:09:26.348752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88cc2727-1de9-409d-96b0-f43e1966acb0 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 204 len: 0 microversion: 2.1 time: 0.137156 Oct 03 16:09:26.349613 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 545/1067] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:26 2022] DELETE /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:09:26.358527 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:26.359241 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:26.366336 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:26.366824 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:26.367264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:26.367997 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:26.368457 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:26.368924 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:26.517201 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:26.525122 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edda7855-6502-4718-87af-6e30ecb6aa06 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1577 microversion: 2.1 time: 0.171166 Oct 03 16:09:26.525776 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 523/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:26 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:27.551172 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:27.551956 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:27.559814 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:27.560384 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:27.560941 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:27.561726 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:27.562183 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:27.562603 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:27.697133 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:27.705186 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00addfc3-97ae-45df-9e47-ea952d0b1747 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1577 microversion: 2.1 time: 0.159145 Oct 03 16:09:27.705742 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 546/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:27 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:28.729096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:28.729716 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:28.736727 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:28.737227 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:28.737668 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:28.738368 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:28.738825 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:28.739251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:28.758181 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e780e0-bcef-4ffd-acd9-5b2e2149670b", "name": "network-vif-deleted", "tag": "b2a35698-8aad-47ff-b894-6f9f24d5bfad"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:28.770910 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:28.771674 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:28.772428 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:28.784297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] Creating event network-vif-deleted:b2a35698-8aad-47ff-b894-6f9f24d5bfad for instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b on hv-cinder-84456 Oct 03 16:09:28.789388 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b5938fee-21e0-4637-8d3a-af907c482625 req-cba686aa-4ee3-44a2-b9a6-3606562fc1a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034895 Oct 03 16:09:28.790013 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 547/1070] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:28.813030 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:28.821007 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd63e5b4-139f-40c6-8fa3-8c05e1cc956d tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 200 len: 1391 microversion: 2.1 time: 0.095882 Oct 03 16:09:28.821583 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 524/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:28 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:29.846959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:29.847756 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 64e780e0-bcef-4ffd-acd9-5b2e2149670b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:29.853917 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:29.854395 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:29.854822 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:29.855499 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:29.856012 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:29.856437 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:29.869467 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] HTTP exception thrown: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Request method failure captured: Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b HTTP/1.1 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwddEJDzmEWOJyfMNN273Qpb075UrY4AZbIEFVqr0loMqAIe8vwqLVAZSdlrUSBLwn8ixRrJlUViSzRlVxqmy5IgSHNngjF7eHSrhEMW1XeYnJm4MHQNQkuEx0A3inZ97_AqCFV-u7Bf_gf-JJeo2T4OD6zvry6P4VQ8qXzQoRGacTI Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:29.871049 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732e98240b4797b941e57f6606e6c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7377a1bca391446eb36b2a3233a7d471 Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. Oct 03 16:09:29.872938 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '64e780e0-bcef-4ffd-acd9-5b2e2149670b'} Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:29.873855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. Oct 03 16:09:29.875337 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:29.876752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Returning 404 to user: Instance 64e780e0-bcef-4ffd-acd9-5b2e2149670b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:29.876752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b339854-0d35-455a-96c6-519623005043 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b" status: 404 len: 111 microversion: 2.1 time: 0.030944 Oct 03 16:09:29.876752 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 548/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:29 2022] GET /compute/v2.1/servers/64e780e0-bcef-4ffd-acd9-5b2e2149670b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:32.957310 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:32.957834 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:32.960014 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb09ecb-c4c2-442c-935c-61a82613b3a7", "tag": "daf87bb6-218f-4859-967c-bcf0cbc9dffe"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:32.964698 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:32.965838 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:32.966768 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:32.967629 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:32.968139 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:32.968667 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:32.980475 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:32.982019 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:32.982463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:32.995264 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:09:32.997397 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] Creating event network-changed:daf87bb6-218f-4859-967c-bcf0cbc9dffe for instance beb09ecb-c4c2-442c-935c-61a82613b3a7 on hv-cinder-84456 Oct 03 16:09:33.002368 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-34580445-5489-414f-953f-176fa4fba3d1 req-d325a3f8-bdf8-4d52-9b85-95a2d1e664b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046345 Oct 03 16:09:33.003190 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 549/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:33.089806 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f474136-ba79-4d58-9c22-c08b9b42328f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 204 len: 0 microversion: 2.1 time: 0.136367 Oct 03 16:09:33.090907 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 525/1074] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:32 2022] DELETE /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:09:33.099786 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:33.101297 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:33.108400 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:33.109129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:33.109759 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:33.110626 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:33.111373 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:33.111793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:33.285459 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:33.293185 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62a40daf-5315-4cc2-8280-7d3ce9bdc203 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1576 microversion: 2.1 time: 0.197770 Oct 03 16:09:33.294420 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 550/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:33 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:33.899031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:33.899613 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:33.906688 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:33.907106 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:33.907544 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:33.908251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:33.908704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:33.909163 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:33.936242 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e3c7960-b5f3-4d45-bf0f-c6dd7d414a25 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/ips" status: 200 len: 148 microversion: 2.1 time: 0.041420 Oct 03 16:09:33.936847 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 526/1076] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:09:33 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:34.318320 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:34.319711 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:34.326241 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:34.326727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:34.327168 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:34.327957 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:34.328413 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:34.328867 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:34.496958 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:34.504868 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f1ab715-0a49-4382-a4cd-e574ffacb076 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1576 microversion: 2.1 time: 0.190617 Oct 03 16:09:34.505787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 551/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:34 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:35.212319 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb09ecb-c4c2-442c-935c-61a82613b3a7", "name": "network-vif-deleted", "tag": "daf87bb6-218f-4859-967c-bcf0cbc9dffe"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:35.223510 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.224072 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.224634 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.237057 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] Creating event network-vif-deleted:daf87bb6-218f-4859-967c-bcf0cbc9dffe for instance beb09ecb-c4c2-442c-935c-61a82613b3a7 on hv-cinder-84456 Oct 03 16:09:35.242268 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a079fd0d-c4d0-4aea-a5f5-66facdaaa29f req-e4e8027f-e1cf-4697-826d-992a80b2ac92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Oct 03 16:09:35.242962 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 527/1078] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:35.279214 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b864823-7b1e-4664-8ad6-b25c82280350"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:35.281730 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:35.287778 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.288332 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.288789 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.289480 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.289927 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.290353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.528056 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:35.528973 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:35.535664 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.536174 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.536574 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.537485 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.538117 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.538543 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.583288 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:35.583778 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:35.584595 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:35.585096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lazy-loading 'fault' on Instance uuid beb09ecb-c4c2-442c-935c-61a82613b3a7 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:09:35.586306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccd9c5c8-defd-4dc5-9efe-42c5fe6a6f09 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "POST /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310923 Oct 03 16:09:35.593765 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 552/1079] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Oct 3 16:09:35 2022] POST /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:35.638175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7377a1bca391446eb36b2a3233a7d471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732e98240b4797b941e57f6606e6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:35.648096 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53d0f362-fcea-4389-b32e-d41ccb15894c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 200 len: 1230 microversion: 2.1 time: 0.124362 Oct 03 16:09:35.648672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 528/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:35 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 1230 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:36.675657 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:36.676415 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: beb09ecb-c4c2-442c-935c-61a82613b3a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:36.682602 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:36.683085 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:36.683528 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:36.684963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:36.685422 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:36.685849 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:36.699504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] HTTP exception thrown: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Request method failure captured: Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 HTTP/1.1 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwddEJDzmEWOJyfMNN273Qpb075UrY4AZbIEFVqr0loMqAIe8vwqLVAZSdlrUSBLwn8ixRrJlUViSzRlVxqmy5IgSHNngjF7eHSrhEMW1XeYnJm4MHQNQkuEx0A3inZ97_AqCFV-u7Bf_gf-JJeo2T4OD6zvry6P4VQ8qXzQoRGacTI Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:36.701770 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732e98240b4797b941e57f6606e6c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7377a1bca391446eb36b2a3233a7d471 Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. Oct 03 16:09:36.703157 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'beb09ecb-c4c2-442c-935c-61a82613b3a7'} Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:36.703916 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. Oct 03 16:09:36.705353 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:36.706864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Returning 404 to user: Instance beb09ecb-c4c2-442c-935c-61a82613b3a7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:36.706864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bcc385c-d884-4cde-9a2b-d87642ba62a6 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7" status: 404 len: 111 microversion: 2.1 time: 0.032443 Oct 03 16:09:36.706864 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 553/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:36 2022] GET /compute/v2.1/servers/beb09ecb-c4c2-442c-935c-61a82613b3a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:37.149344 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:37.149832 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:37.157147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:37.157601 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:37.158029 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:37.158704 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:37.159147 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:37.159554 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:37.173390 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] HTTP exception thrown: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Request method failure captured: Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec HTTP/1.1 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwddEJDzmEWOJyfMNN273Qpb075UrY4AZbIEFVqr0loMqAIe8vwqLVAZSdlrUSBLwn8ixRrJlUViSzRlVxqmy5IgSHNngjF7eHSrhEMW1XeYnJm4MHQNQkuEx0A3inZ97_AqCFV-u7Bf_gf-JJeo2T4OD6zvry6P4VQ8qXzQoRGacTI Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:09:37.175019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732e98240b4797b941e57f6606e6c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 7377a1bca391446eb36b2a3233a7d471 Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.176676 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '2ee7b689-24a1-4318-b643-8e02216f7dec'} Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:37.177689 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.179186 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.180830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Returning 404 to user: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:37.180830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5795615e-1ab5-428e-8b35-24ce1d111d8c tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 404 len: 111 microversion: 2.1 time: 0.031005 Oct 03 16:09:37.180830 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 529/1082] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:37 2022] DELETE /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:37.186174 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:37.187003 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] [instance: 2ee7b689-24a1-4318-b643-8e02216f7dec] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:37.194610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:37.195081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:37.195508 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:37.196189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:37.196633 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:37.197075 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:37.210896 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] HTTP exception thrown: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Request method failure captured: Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec HTTP/1.1 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwddEJDzmEWOJyfMNN273Qpb075UrY4AZbIEFVqr0loMqAIe8vwqLVAZSdlrUSBLwn8ixRrJlUViSzRlVxqmy5IgSHNngjF7eHSrhEMW1XeYnJm4MHQNQkuEx0A3inZ97_AqCFV-u7Bf_gf-JJeo2T4OD6zvry6P4VQ8qXzQoRGacTI Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:37.212406 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732e98240b4797b941e57f6606e6c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732e98240b4797b941e57f6606e6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 40732e98240b4797b941e57f6606e6c5 Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-467882445 Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7377a1bca391446eb36b2a3233a7d471 Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-467882445-project Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.214067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '2ee7b689-24a1-4318-b643-8e02216f7dec'} Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:37.215132 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. Oct 03 16:09:37.216782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:37.218223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Returning 404 to user: Instance 2ee7b689-24a1-4318-b643-8e02216f7dec could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:37.218223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce944140-a312-49d1-acef-84033d316a14 tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec" status: 404 len: 111 microversion: 2.1 time: 0.032672 Oct 03 16:09:37.218223 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 554/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:37 2022] GET /compute/v2.1/servers/2ee7b689-24a1-4318-b643-8e02216f7dec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:38.508219 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5dff264d-8aeb-41ec-a6f1-02933f64da7f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] Calling method '.version_select at 0x7f8174d999d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:38.539251 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5dff264d-8aeb-41ec-a6f1-02933f64da7f tempest-TestVolumeBootPattern-467882445 tempest-TestVolumeBootPattern-467882445-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-215967939" status: 202 len: 0 microversion: 2.1 time: 0.034746 Oct 03 16:09:38.539794 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 530/1084] 10.222.0.33 () {58 vars in 1260 bytes} [Mon Oct 3 16:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-215967939 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:43.300668 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:43.309792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:43.312609 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:43.318562 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:43.319221 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:43.319970 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:43.320846 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:43.322079 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:43.322670 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:43.326694 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:43.429151 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lazy-loading 'services' on Instance uuid b6ba4b3d-c2d4-438b-83fc-b4fad378d66d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:09:43.513821 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f851c953-971f-4b70-aef1-8f191d5bf3ee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments/9b864823-7b1e-4664-8ad6-b25c82280350" status: 202 len: 0 microversion: 2.1 time: 0.216842 Oct 03 16:09:43.514497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 555/1085] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Oct 3 16:09:43 2022] DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments/9b864823-7b1e-4664-8ad6-b25c82280350 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:43.522963 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:43.525943 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:43.529459 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:43.535276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:43.536283 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:43.536869 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:43.537623 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:43.538135 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:43.538750 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:43.543951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:43.579024 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce935636-23e5-4637-9b4b-182e3c2cce12 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059937 Oct 03 16:09:43.579906 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 531/1086] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:09:43 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:44.596933 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:44.602002 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:44.611366 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.611863 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.612309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:44.613015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.613463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.613879 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:44.650862 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd280a52-25c6-42a2-aa7d-2aae21f44aea tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062488 Oct 03 16:09:44.651682 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 556/1087] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Oct 3 16:09:44 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 16:09:44.728104 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:44.729391 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:44.738363 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.739282 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.739904 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:44.741178 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.741829 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.742915 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:44.772931 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:09:44.883287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d025a2a6-9b4d-4d64-bb7e-994ecab47046 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 204 len: 0 microversion: 2.1 time: 0.154297 Oct 03 16:09:44.883287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 532/1088] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:44 2022] DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:09:44.889516 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:44.890129 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:44.897134 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.897723 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.898409 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:44.899333 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:44.900026 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:44.900669 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:45.124828 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:45.135175 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9f857f0-89e2-441b-a5d4-3b15439700e8 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1679 microversion: 2.1 time: 0.249367 Oct 03 16:09:45.149293 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 557/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:44 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:46.160334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:46.161181 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:46.167850 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:46.168334 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:46.168786 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:46.169483 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:46.169928 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:46.170342 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:46.312766 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:46.320553 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e399f106-0de8-4548-a354-1c634d77172c tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1679 microversion: 2.1 time: 0.164577 Oct 03 16:09:46.321142 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 533/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:46 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:47.343950 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:47.344688 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:47.351487 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:47.358465 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:47.358934 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:47.359678 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:47.360138 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:47.360560 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:47.469201 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1db8ef8c44763a0e5f62a3404a834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62932ad37df941b1840b183a858c7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:47.494497 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-654d1e9e-89b7-4ed8-b949-51ff2dc0e345 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 200 len: 1611 microversion: 2.1 time: 0.150617 Oct 03 16:09:47.505403 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 558/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:47 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 1611 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:47.669380 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ba4b3d-c2d4-438b-83fc-b4fad378d66d", "name": "network-vif-deleted", "tag": "eae060f4-2959-4b95-8e8f-78604da0114e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:47.680055 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:47.680529 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:47.680991 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:47.705019 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] Creating event network-vif-deleted:eae060f4-2959-4b95-8e8f-78604da0114e for instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d on hv-cinder-84456 Oct 03 16:09:47.711089 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3c9804d1-021c-4c41-9622-04e64bd804ae req-4d16c8ed-1642-451e-ac33-2e0b16a7f3ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311932 Oct 03 16:09:47.717672 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 534/1092] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 16:09:48.530113 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:48.530736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:48.537672 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:48.538189 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:48.538625 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:48.539336 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:48.539793 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:48.540219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:48.555255 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d HTTP/1.1 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:48.557021 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:48.558712 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'b6ba4b3d-c2d4-438b-83fc-b4fad378d66d'} Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:48.560259 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:48.562011 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:48.563524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:48.563524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-326480a0-d6c1-4ed9-81a7-d88c591928fa tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 404 len: 111 microversion: 2.1 time: 0.033006 Oct 03 16:09:48.563524 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 559/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:48 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:48.569616 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad802cd6-e706-4050-a799-a5d6a5fce364 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '.version_select at 0x7f81750d1700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:48.588642 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad802cd6-e706-4050-a799-a5d6a5fce364 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958535874" status: 202 len: 0 microversion: 2.1 time: 0.023749 Oct 03 16:09:48.589242 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 535/1094] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958535874 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:09:50.610071 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:50.610595 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:50.617286 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:50.617756 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:50.618182 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:50.618856 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:50.619299 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:50.619718 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:50.633761 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d HTTP/1.1 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:50.635735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.638145 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'b6ba4b3d-c2d4-438b-83fc-b4fad378d66d'} Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:50.639036 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.640542 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.641859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:50.641859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f464571e-6c4d-47a8-9622-e487d9363f64 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 404 len: 111 microversion: 2.1 time: 0.033207 Oct 03 16:09:50.641859 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 560/1095] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:50 2022] DELETE /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:50.649530 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:50.650260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: b6ba4b3d-c2d4-438b-83fc-b4fad378d66d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:50.658027 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:50.658504 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:50.658939 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:50.659625 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:50.660073 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:50.660495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:50.673735 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d HTTP/1.1 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:09:50.675335 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.676969 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'b6ba4b3d-c2d4-438b-83fc-b4fad378d66d'} Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:50.677790 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. Oct 03 16:09:50.679140 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:50.680513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance b6ba4b3d-c2d4-438b-83fc-b4fad378d66d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:50.680513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04d78018-2fb4-498b-acb0-f72de8fed2ef tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d" status: 404 len: 111 microversion: 2.1 time: 0.031845 Oct 03 16:09:50.680513 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 536/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:50 2022] GET /compute/v2.1/servers/b6ba4b3d-c2d4-438b-83fc-b4fad378d66d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:51.821261 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:51.821735 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:51.828823 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.829301 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.829733 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.830423 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.830874 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.831561 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.846279 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 HTTP/1.1 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:51.847804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.849590 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'c5ded878-d512-4b70-9de3-49f7dc9b8a56'} Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:51.850566 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.852055 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.853610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:51.853610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33f20911-66a5-4e5e-879f-eabe974fb3bc tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 404 len: 111 microversion: 2.1 time: 0.031819 Oct 03 16:09:51.853610 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 561/1097] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:51 2022] DELETE /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:51.857842 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:51.858463 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: c5ded878-d512-4b70-9de3-49f7dc9b8a56] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:51.864848 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.865323 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.865756 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.866447 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.866899 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.867321 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.880946 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 HTTP/1.1 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:09:51.882438 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.884036 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'c5ded878-d512-4b70-9de3-49f7dc9b8a56'} Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:51.885012 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. Oct 03 16:09:51.886521 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.888643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance c5ded878-d512-4b70-9de3-49f7dc9b8a56 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:51.888643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88a59e43-c78a-4562-ab61-680fc3436c85 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56" status: 404 len: 111 microversion: 2.1 time: 0.030015 Oct 03 16:09:51.888643 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 537/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:51 2022] GET /compute/v2.1/servers/c5ded878-d512-4b70-9de3-49f7dc9b8a56 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:09:51.892807 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:51.893310 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:51.899248 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.899719 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.900148 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.900855 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.901306 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.901727 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.914959 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 HTTP/1.1 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:51.916472 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.918116 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'ae3245cd-404a-4f9a-aa0f-53ea7d62f307'} Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:51.919039 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.920600 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.922224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:51.922224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9109d9f7-0fe7-4d6d-86a1-e3cec3d65765 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 404 len: 111 microversion: 2.1 time: 0.028982 Oct 03 16:09:51.922224 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 562/1099] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:51 2022] DELETE /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:09:51.926207 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:51.926817 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: ae3245cd-404a-4f9a-aa0f-53ea7d62f307] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:51.933054 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.933392 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.934404 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.935249 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:51.935826 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:51.936260 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:51.950217 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 HTTP/1.1 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:09:51.951722 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.953462 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'ae3245cd-404a-4f9a-aa0f-53ea7d62f307'} Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:51.954584 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. Oct 03 16:09:51.956137 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:51.957646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance ae3245cd-404a-4f9a-aa0f-53ea7d62f307 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:51.957646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d830109d-f2e1-4998-bd3c-698109cb7e6e tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307" status: 404 len: 111 microversion: 2.1 time: 0.030894 Oct 03 16:09:51.957646 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 538/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:51 2022] GET /compute/v2.1/servers/ae3245cd-404a-4f9a-aa0f-53ea7d62f307 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:53.092794 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:53.093309 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:53.099685 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:53.100167 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:53.100604 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:53.101326 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:53.101785 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:53.102210 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:53.115928 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 HTTP/1.1 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:09:53.117491 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: > Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.119170 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': '8c3d4b57-0c64-40bb-8710-b8e721815147'} Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:53.121015 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.123142 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.124741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:53.124741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c431928b-4c2f-4383-a8b2-1eed2b7e9fee tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 404 len: 111 microversion: 2.1 time: 0.030084 Oct 03 16:09:53.124741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 563/1101] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Oct 3 16:09:53 2022] DELETE /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:53.127865 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:53.128470 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] [instance: 8c3d4b57-0c64-40bb-8710-b8e721815147] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:53.134835 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:53.135307 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:53.135730 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:53.136403 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Acquiring lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:53.136923 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:53.137495 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Lock "5d3daa5e-fb60-4c09-9b5d-f502e7858b1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:53.151256 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] HTTP exception thrown: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Request method failure captured: Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 HTTP/1.1 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwgt0BxFtXTY4BRgOIHEQtAW5xLUKijPqPJm_kSQU7_IbxhgQxSTMq4u7_9qw2J3ONtG73QVvfT9X2Yaxabhn1-Bx0z6rtrH_jOsCAOFrXcBOyI5CoCQ7G7XRb7XQ__BLF5O4Sy6eowFTmsOKrseezWwh7kNtnqBVsy9-8LemijV70Q Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:09:53.153413 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62932ad37df941b1840b183a858c7876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62932ad37df941b1840b183a858c7876", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62932ad37df941b1840b183a858c7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 62932ad37df941b1840b183a858c7876 Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628838770 Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 4cc1db8ef8c44763a0e5f62a3404a834 Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1628838770-project Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: > Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.155287 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '8c3d4b57-0c64-40bb-8710-b8e721815147'} Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:09:53.156228 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. Oct 03 16:09:53.157947 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:09:53.159641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] Returning 404 to user: Instance 8c3d4b57-0c64-40bb-8710-b8e721815147 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:09:53.159641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa304cdf-6967-4fdf-9c26-d743f33f7083 tempest-AttachVolumeNegativeTest-1628838770 tempest-AttachVolumeNegativeTest-1628838770-project] 10.222.0.33 "GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147" status: 404 len: 111 microversion: 2.1 time: 0.031144 Oct 03 16:09:53.159641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 539/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:53 2022] GET /compute/v2.1/servers/8c3d4b57-0c64-40bb-8710-b8e721815147 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:09:58.675787 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24b97242-01ce-4859-90db-c93039909984 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174e55b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:58.723444 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24b97242-01ce-4859-90db-c93039909984 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5c931862-1d40-4dbc-92b3-59ec0d2d785e" status: 200 len: 351 microversion: 2.1 time: 0.051372 Oct 03 16:09:58.724504 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 564/1103] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 16:09:58 2022] GET /compute/v2.1/os-volumes/5c931862-1d40-4dbc-92b3-59ec0d2d785e => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:00.061061 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03028e3d-385a-4a1f-b2c9-50bee0d718c3 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174c1aaf0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:00.107318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03028e3d-385a-4a1f-b2c9-50bee0d718c3 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2f2847db-300f-45ec-9787-2d25abd16a89" status: 200 len: 349 microversion: 2.1 time: 0.051053 Oct 03 16:10:00.107895 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 540/1104] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 16:10:00 2022] GET /compute/v2.1/os-volumes/2f2847db-300f-45ec-9787-2d25abd16a89 => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:01.458347 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8027f06e-2329-46d5-8946-d55de3b57dd6 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8178504e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.511473 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8027f06e-2329-46d5-8946-d55de3b57dd6 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6bc93d00-c032-4937-9b8e-4cec408f0916" status: 200 len: 349 microversion: 2.1 time: 0.057363 Oct 03 16:10:01.512804 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 565/1105] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes/6bc93d00-c032-4937-9b8e-4cec408f0916 => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:01.525921 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0c4c50b-689d-4e10-aa48-71d94adae3bd tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174fd33a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.606894 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0c4c50b-689d-4e10-aa48-71d94adae3bd tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.085170 Oct 03 16:10:01.607465 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 541/1106] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:01.621779 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6569e496-8d86-4f27-ad8f-60d34258a6a5 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8178413160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.705490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6569e496-8d86-4f27-ad8f-60d34258a6a5 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.087958 Oct 03 16:10:01.706053 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 566/1107] 10.222.0.33 () {58 vars in 1149 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:01.720190 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e55aa0de-6878-4bd3-bbcd-1f1a2f6039e4 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8175116d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.802713 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e55aa0de-6878-4bd3-bbcd-1f1a2f6039e4 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.086194 Oct 03 16:10:01.803284 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 542/1108] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:01.816963 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d81847f-1005-4dfe-b501-8a8d2e91f05b tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174ff20d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.898056 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d81847f-1005-4dfe-b501-8a8d2e91f05b tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.084742 Oct 03 16:10:01.898645 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 567/1109] 10.222.0.33 () {58 vars in 1167 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:01.913005 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ee8872f-ad1e-4556-8935-07efd5178dba tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174d88670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:01.995270 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ee8872f-ad1e-4556-8935-07efd5178dba tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.085702 Oct 03 16:10:01.996026 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 543/1110] 10.222.0.33 () {58 vars in 1170 bytes} [Mon Oct 3 16:10:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:02.009741 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9bd4518-f714-46e5-af28-2fd5371a982d tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174e55e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:02.096342 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9bd4518-f714-46e5-af28-2fd5371a982d tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.090331 Oct 03 16:10:02.096961 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 568/1111] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Oct 3 16:10:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:02.111951 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f49b8c60-f18e-4dfd-8073-11d435fa9315 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8174b71af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:02.194599 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f49b8c60-f18e-4dfd-8073-11d435fa9315 tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.086500 Oct 03 16:10:02.195195 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 544/1112] 10.222.0.33 () {58 vars in 1188 bytes} [Mon Oct 3 16:10:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:02.208878 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54013702-3e9d-440c-b404-012416542b1e tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] Calling method '.version_select at 0x7f8178413790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:02.291067 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54013702-3e9d-440c-b404-012416542b1e tempest-VolumesTestJSON-1987340882 tempest-VolumesTestJSON-1987340882-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.085918 Oct 03 16:10:02.291658 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 569/1113] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Oct 3 16:10:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:06.974803 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:06.975546 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:07.090710 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75978b6a-22f2-4b41-a8f6-e54e2ca57746 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Action: 'create', calling method: .version_select at 0x7f8174e7aee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1840534990", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75978b6a-22f2-4b41-a8f6-e54e2ca57746 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 122 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:10:07.099552 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1840534990", "metadata": {"Type": "work"}}} Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: Oct 03 16:10:07.101265 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1840534990', 'metadata': {'Type': 'work'}}}} Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.105350 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 16:10:07.107136 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 16:10:07.108641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 16:10:07.108641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.108641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75978b6a-22f2-4b41-a8f6-e54e2ca57746 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.108641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75978b6a-22f2-4b41-a8f6-e54e2ca57746 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127399 Oct 03 16:10:07.108641 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 545/1114] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 16:10:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:10:07.109102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=17 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:07.109102 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:07.112660 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-869c6f55-54d1-4869-8bfc-ab9399ea713b tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Action: 'create', calling method: .version_select at 0x7f81784130d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-872358564", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-869c6f55-54d1-4869-8bfc-ab9399ea713b tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 119 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:10:07.117171 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-872358564", "metadata": {"Type": "work"}}} Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 16:10:07.119008 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-872358564', 'metadata': {'Type': 'work'}}}} Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '0' Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.120041 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 16:10:07.121792 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 16:10:07.123527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 16:10:07.123527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.123527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-869c6f55-54d1-4869-8bfc-ab9399ea713b tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.123527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-869c6f55-54d1-4869-8bfc-ab9399ea713b tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011692 Oct 03 16:10:07.123527 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 570/1115] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 16:10:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:10:07.127903 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db92988b-e9bc-4807-aa79-6f7861dba1ad tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Action: 'create', calling method: .version_select at 0x7f8174d994c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1216083475", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db92988b-e9bc-4807-aa79-6f7861dba1ad tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 119 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:10:07.131569 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1216083475", "metadata": {"Type": "work"}}} Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: Oct 03 16:10:07.133311 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1216083475', 'metadata': {'Type': 'work'}}}} Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.134233 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 16:10:07.135723 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 16:10:07.137603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 16:10:07.137603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.137603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db92988b-e9bc-4807-aa79-6f7861dba1ad tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.137603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db92988b-e9bc-4807-aa79-6f7861dba1ad tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008798 Oct 03 16:10:07.137603 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 546/1116] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Oct 3 16:10:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 16:10:07.142635 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7398d4b0-cc10-4484-8ba4-67ec7e4fc093 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Calling method '.version_select at 0x7f817849caf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:07.171736 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7398d4b0-cc10-4484-8ba4-67ec7e4fc093 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] HTTP exception thrown: Volume tempest-invalid-1732466456 could not be found. Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7398d4b0-cc10-4484-8ba4-67ec7e4fc093 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1732466456 HTTP/1.1 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:10:07.173751 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Volume tempest-invalid-1732466456 could not be found. Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'tempest-invalid-1732466456'} Oct 03 16:10:07.175449 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1732466456 could not be found. (HTTP 404) (Request-ID: req-3ca8eab5-7cd1-484d-9063-a672e5b83805) Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.176463 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 16:10:07.178028 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1732466456 could not be found. Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:10:07.179490 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1732466456 could not be found. Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1732466456 could not be found. Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7398d4b0-cc10-4484-8ba4-67ec7e4fc093 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 404 to user: Volume tempest-invalid-1732466456 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7398d4b0-cc10-4484-8ba4-67ec7e4fc093 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1732466456" status: 404 len: 99 microversion: 2.1 time: 0.036133 Oct 03 16:10:07.181213 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 571/1117] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Oct 3 16:10:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1732466456 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 16:10:07.184876 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-abfe50ef-743b-42e6-a6f5-a0885fef9008 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003849 Oct 03 16:10:07.185422 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 547/1118] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Oct 3 16:10:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 16:10:07.193478 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9622e592-af4e-4f45-bb90-db3f73944ddb tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003677 Oct 03 16:10:07.193983 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 572/1119] 10.222.0.33 () {58 vars in 1137 bytes} [Mon Oct 3 16:10:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 03 16:10:07.203318 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-843be85b-9faf-4cfc-978b-8ace6d0c4f80 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Calling method '.version_select at 0x7f8174c455e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:07.231276 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-843be85b-9faf-4cfc-978b-8ace6d0c4f80 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] HTTP exception thrown: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-843be85b-9faf-4cfc-978b-8ace6d0c4f80 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-volumes/233bc163-6a5d-45f6-bd60-36f867c81e7a HTTP/1.1 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept: application/json Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Connection: close Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.33 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Role: reader,member Oct 03 16:10:07.233237 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Roles: reader,member Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: method: Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: exception: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '233bc163-6a5d-45f6-bd60-36f867c81e7a'} Oct 03 16:10:07.234972 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. (HTTP 404) (Request-ID: req-f324b3c9-a4d8-4e33-8611-f8cfae88ec18) Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.236031 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 16:10:07.237549 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 16:10:07.239175 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-843be85b-9faf-4cfc-978b-8ace6d0c4f80 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 404 to user: Volume 233bc163-6a5d-45f6-bd60-36f867c81e7a could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-843be85b-9faf-4cfc-978b-8ace6d0c4f80 tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/233bc163-6a5d-45f6-bd60-36f867c81e7a" status: 404 len: 109 microversion: 2.1 time: 0.036123 Oct 03 16:10:07.240673 dv-cinder-844563-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 548/1120] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Oct 3 16:10:07 2022] DELETE /compute/v2.1/os-volumes/233bc163-6a5d-45f6-bd60-36f867c81e7a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 16:10:07.244099 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a82382e-34ba-4609-8984-5d2e82689fbf tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Calling method '.version_select at 0x7f8178504e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:07.271529 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5a82382e-34ba-4609-8984-5d2e82689fbf tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] HTTP exception thrown: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a82382e-34ba-4609-8984-5d2e82689fbf tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Request method failure captured: Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/ce917f56-6ced-439f-aa6a-519d6392f148 HTTP/1.1 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept: application/json Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Connection: close Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Length: 0 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Content-Type: application/json Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Host: 10.222.0.33 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjOwle-iU-8JrfEdlncasH2FgnzXHdiJFpi_YdtyIaRy-4JhCv9ZwEQ2xUBBAzfn_EOU3N-q9nLK5scHw3C_rC5hFCw9-AKpIf4jFaaFVfpilfYbXEHw6shHv6oYjcW6fdnpVmcZznahLh3YFJoX9pt-LUWB7nJgwF9_9QyRd2KD3zGWU Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Role: reader,member Oct 03 16:10:07.273485 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Roles: reader,member Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/59db6d317c4846228409634459ad1698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_59db6d317c4846228409634459ad1698", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/59db6d317c4846228409634459ad1698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 59db6d317c4846228409634459ad1698 Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-210794832 Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Id: 7b845d94440f434ba4d711ef275fbd82 Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-210794832-project Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: method: Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: exception: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: action_args: {'id': 'ce917f56-6ced-439f-aa6a-519d6392f148'} Oct 03 16:10:07.275153 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. (HTTP 404) (Request-ID: req-26895025-c9f0-4795-ac6a-56c0e0765c73) Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.276081 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 16:10:07.278219 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 16:10:07.279782 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a82382e-34ba-4609-8984-5d2e82689fbf tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] Returning 404 to user: Volume ce917f56-6ced-439f-aa6a-519d6392f148 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a82382e-34ba-4609-8984-5d2e82689fbf tempest-VolumesNegativeTest-210794832 tempest-VolumesNegativeTest-210794832-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ce917f56-6ced-439f-aa6a-519d6392f148" status: 404 len: 109 microversion: 2.1 time: 0.034584 Oct 03 16:10:07.281348 dv-cinder-844563-13-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 573/1121] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Oct 3 16:10:07 2022] GET /compute/v2.1/os-volumes/ce917f56-6ced-439f-aa6a-519d6392f148 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)